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Abstract 

This is the second part of a study of the hmiting distributions of the top eigenvalues of a 
Hermitian matrix model with spiked external source under a general external potential. The 
case when the external source is of rank one was analyzed in an earlier paper. In the present 
paper we extend the analysis to the higher rank case. If all the eigenvalues of the external 
source are less than a critical value, the largest eigenvalue converges to the right end-point of 
the support of the equilibrium measure as in the case when there is no external source. On the 
other hand, if an external source eigenvalue is larger than the critical value, then an eigenvalue 
is pulled off from the support of the equilibrium measure. This transition is continuous, and is 
universal, including the fluctuation laws, for convex potentials. For non-convex potentials, two 
types of discontinuous transitions are possible to occur generically. We evaluate the limiting 
distributions in each case for general potentials including those whose equilibrium measure have 
multiple intervals for their support. 



1 Introduction 



Let y : M — 7- M be an analytic function such that J^^^"^^ — ?■ -|-oo as \x\ — ?• ±00. Let A„ be an n x n 
Hermitian matrix and consider the probability density function (p.d.f.) on the set Tin of n x n 
Hermitian matrices defined by 

Here Zn is the normalization constant so that pn{M)dM = 1 where dM denotes the Lebesgue 
measure. The sequence of probability spaces {'Hn,Pn), n- = 1,2, • • • , is called a Hermitian matrix 
model with external source matrices An, n = 1,2,---, and potential V. Note that due to the 
unitary invariance of dM and the presence of the trace in the exponent of ([T|), the density pn{M) 
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depends only on the eigenvalues of A„. Hence we niciy assume without loss of generality that 
is a diagonal matrix. 

The main focus of this paper is the special case when 

A„ = diag(ai,--- ,am,0, ••• ,0) (2) 



for all n > m with fixed nonzero fii, * * * ^a-m* (^Ve also consider the case when a^ depend on n. 
Indeed, in transitional cases we assume aj varies in n but converges to a fixed value as n — ?• oo.) 
In this case, (TinjPn) is called a Hermitian matrix model with spiked external source {spiked model 
for short) of rank m. The main interest of this paper is to study how the limiting location and the 
fluctuation of the top eigenvalue(s) of M as n — t- oo depend on the "external source eigenvalues" 

The case when m = 1 (rank one case) was studied in [8] to which we refer the readers for the 
background and motivations of the spiked models. See also [1], [23], [B], [TH], [2D], [27], [H], [T], 

m, en], [H], m, m, m, and m- 

The spiked model of an arbitrary fixed rank was studied in great detail for Gaussian potential 
in |23| and also for the so-called complex Wishart spiked models in [3] . Let us review the Gaussian 
case here. Let e denote the right end-point of the support of the equilibrium measure associated 
to the potential V. For the Gaussian potential V{x) = ^x^, e = 2. Let S,max{n) denote the largest 
eigenvalue of the random matrix of size n. Then there is a constant /? > such that 

F„((e.a.(n) - e)/3nV3 < . . . , ^ |^o(T), if max{a„ • • • , a.} < ly' (e), 

[F^{T), ifai = --- = am = iF'(e). 

On the other hand, if ai = • • • = am > ^V(e), there is a constant a;o(ai) > e and 7(ai) > such 
that 

lPn((W(n)-2;o(ai))7(ai)ni/2<T;ai,-- - ,a^)^Gm{T) (4) 

for each T G M, as n — )• oo. Here Fm{T), m = 0, 1, 2, • • • , and Gm{T), m = 1, 2 • • • , are certain 
cumulative distribution functions. The constant XQ{a) is a continuous function in a £ (|y'(e),oo) 
and satisfies x{a) I e as a I ^^'(e). Hence for the Gaussian potential, as a^'s increase, the limiting 
location ^max := limn->-oo ?max("-) stays at the right end-point e of the support of the equilibrium 
measure until a^'s reach the critical value ^V'{e). After the critical value, .^max break off from e 
and moves to the right continuously. 

This continuity of ^max does not necessarily hold for general potentials. Indeed, for the rank 
1 case it was shown in [8] that .^max may be a discontinuous function of the (unique) external 
eigenvalue for certain potentials. (It was shown that .^max is continuous when V{x) is convex in 
X > e. A criterion when the discontinuity occurs is given in [8].) If F is such a a potential, then 
Cmax for the potentials sV is also discontinuous for all s close enough to 1. An example of such V 
can be constructed by considering a two-well potential with a deep well of the left and a shallow 
well on the right. Nevertheless there still is universality: it was shown in the rank 1 case that 
the limiting distribution of ^max(?^) at the continuous points of ^max is (generically) same as that 
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of the Gaussian potential. (It though varies depending on whether the external eigenvalue is sub- 
critical, critical, and super-critical.) Even more, at a discontinuous point, the limiting distribution 
is something new but it is still (generically) independent of V. In this paper we show that similar 
universality also holds for the higher rank case. 

While [8] and the current paper were being written, a work on a similar subject was announced 
in the recent preprints by Bertola et al. [11] and [12]. The major difference of their work and ours 
is that we take a-,'s to be all distinct and keep m fixed, while |lHll2j take to be identical and let 
m — 7- oo with m = o{n). Hence these two works complement each other. The methods are different 
and it seems that each has an unique advantage in handling the situations mentioned above; see 
Remark 11.31 below . See also Section 1.1 of [8] for a further comparison. 

1.1 Algebraic relation of the higher rank case and the rank 1 case 

The starting point of analysis in this paper is a simple algebraic relation between the higher rank 
case and the rank 1 case. The gap probability, for example, can be written as a finite determinant 
built out of the gap probabilities of rank 1 cases. 

In order to state this algebraic relation, we slightly generalize the setting of the spiked model. 
Note that in the definition of the density ([T]), the factor n in front of Tr{V{M) — A„M) equals the 
dimension of the matrices M and A„. We may take the factor different from the dimension and 
consider the following p.d.f. : 

PdAM) := ^e-"T'-(^(*^)-^'^*^), M G Ti,, (5) 

where 

Ad = diag(ai, • • • ,am, 0,-- ,0 ) (6) 

m 

for some nonzero numbers ai, • • • , am. Define, for a complex number s and a measurable subset E 
of M, 



r d 

^d,n(ai,--- ,ani;-E';s) := E 



11(1 -sxEm =[ 11(1 - sxEmPd,n{M)dM (7) 



where ^j, j = 1, ■ ■ ■ ,d denote the eigenvalues of M. It is well known that (see e.g. [26] ) 

£d E;s). (8) 



1=0 



s=l 



is the probability that there are no more than j — 1 eigenvalues in E. When E = (x,oo), this is 
precisely the cumulative distribution function (c.d.f.) of the jth largest eigenvalue. When A^ = 
we denote ([7]) by £d,n{E; s), and also define 

C / IP \ £d,n{^i,-" ,^m',E;s) 

£d,n[^i,- ■ ■ ,am;E;s) := — — — . (9) 
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Let Pj{x; n), j = 0, 1, • • • , be the orthonormal polynomials with respect to the (varying) measure 
g-ny(x)^^ and set ipj{x;n) := pj(x;n)e~2^^^\ Define 

Tj{a;n):= [ e''^''''-^^'''^/^^j{x-n)dx. (10) 

The following identity relates the higher rank case to the rank one cases. 

Theorem 1.1. Let E he a subset o/M and let s he a complex number such that £ri-j+i,n{E] s) 7^ 
for all j = 1, ■ ■ ■ , m. We have for distinct ai, • • • , a^, 

det[Tn-jiak;n)£n-j+i,nia.k;E;s)]'^^^^ 

£n,n[^ir ' ' ^^m', E; S) = TTTF 77. vfm ' • (11) 

det [Tn-j{ak ,n)\.^i^^^ 

Remark 1.1. When some aj are identical, the above theorem still holds by using L'Hopital's rule. 
This follows from the smooth dependence of the quantities above in a^'s which can be proved 
directly. The explicit smooth dependence of multiple orthogonal polynomials on aj's, which is 
essentially equivalent to the smooth dependence of quantities in (jlip . is shown in, for example, 
\20\ [TT\ [T2] in similar situations. However, in the rest of the paper, we consider only the case when 



aj are all distinct. 

From the above theorem, the study of the limiting distribution of the eigenvalue of higher rank 
case may be reduced to a study of rank 1 case, which was done in [8]. However, for the interesting 
cases when a^-'s converge to the same number in the limit, the numerator and denominator both tend 
to zero and thus we need to perform suitable row and column operations and extract the common 
decaying factors to make the ratio finite. This requires us to extend the asymptotic result of Baik 
and Wang [8] to include the sub-leading terms of the asymptotics of £n-j+i,ni^k', E; s). Nevertheless 
we requires only the existence of the asymptotic expansion but not the exact formulas, and hence 
most of the extension of the result of Baik and Wang (8] is straightforward. The technical part is 
the row and column operations and to show that the ratio becomes finite after factoring out the 
common terms. 

1.2 Assumptions on potential V and some preliminary notations 

In this section, we first state the precise conditions on V. Then we fix some notations and discuss 
a few important results of the rank 1 case. 

Assume that V satisfies the following three conditions: 



V{x) is real analytic in M, (12) 

V{x) 
Vx^ + 1 

V is 'regular'. (14) 



+00 as l^l — )• 00, (13) 



At the end of this section, we will discuss additional technical assumptions on V. 

Here the regularity of F is a condition defined in [16] which we do not state explicitly here. We 
note only that this condition holds for "generic" V [19] and for such V, the density ^{x) of the 
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associate equilibrium measure (the limiting empirical measure when there is no external source) 
vanishes like a square-root at the edges of its support. 

In the usual unitary ensembles (with no external source), the condition (113p is typically replaced 
by ~^ +00 as |x| — )■ 00 [16]. Here ([T3|) is needed to ensure that the probability density ([T]) 

is well defined for all (spiked) A^. 

With the above assumptions, the support ^{x) consists of finitely many intervals: 

N 

, Oj+i), where 60 < oi < • • • < aN+i, (15) 

3=0 

for some N > 0. Note that we allow in this paper that N can be larger than 0. We denote the 
right end-point of J by 

e := QN+i (16) 

as in [8]. We also set 

P:={M.^f\ (17) 

By the condition (jl4p . /3 is a nonzero positive number. It is also known that under the above 
assumptions (see |16] and |15j ) for the usual unitary ensemble with no external source, 

lim P„ (the largest eigenvalue < e + , ) = Fo(T), (18) 

where Fq is the Tracy- Widom distribution (see (j34p for definition.) 

We now recall a few notations and results from the analysis of rank one case [8]. Let 

^{z) := j \og{z - s)^{s)ds, zeC\(-oo,e), (19) 

be the so-called g-function associated to V . Let I be the Robin constant which is defined by the 
condition 

g+(x)+g_(rE) -y(x) =£, xeJ. (20) 

We also define two functions 

G[z;a):=^{z)-V{z)+az, ^{z;a) := -g{z) + az + I (21) 

for a > 0. These functions play an important role in the analysis of rank one case. Observe that 
G(e;a) = H(e;a) from ([201) . The function H(x;a) is convex in x G [e,oo). Let c(a) € [e, 00) be 
the point at which H(a;; a) takes its minimum. It is easy to check that c(a) = e for a > ^V'{e) and 
c(a) > e for a < ^V'{e). 

Now let Sic be the critical value associated to V defined by 

SLc := inf{a G (0,oo)| there exists x £ (c(a), 00), 00) such that G(x;a) > H(c(a);a)}. (22) 
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In general, S (0, ^^'(e)]. If V{x) is convex for x > e, then slc = ^V{e). The hmiting location of 
the largest eigenvalue in the rank one case depends on whether a < slc or a > ac. Here we denote 
it by ^(a) to indicate the dependence of on a. 

Super-critical case: Set 

J'v ■= {a G [ac,oo)| max G{x;a) attains its maximum at more than one point}. (23) 

a:6[c(a),oo) 

This is a discrete set. If V{x) is convex in x > e, then J7V = 0. For a > slc such that a ^ Jv, 
let xo(o) denote the point in [c(a), oo) at which G{x;a) takes its maximum. For such a, it was 
shown that xo{a) is a continuous, strictly increasing function. Moreover, ^(a), the limiting location 
of the largest eigenvalue in the rank one case, equals xo{a) in this case. On the other hand, if 
a > slc and a £ J'v, then ^(a) is a discrete random variable whose values are the maximizers 
of maXj.g(c(£,) G(x; a) (there are at least two of them). We call a > ac such that a E J'v the 
secondary critical values. 

Sub-critical case: On the other hand, if a < ac, then ^(a) = e. 

Critical case: At the critical case when a = ac, ^(a) depends on whether ac = ^V'{e) or 
ac < ^y(e). In both cases, let us assume that ac ^ Jv- Then when ac = ^V'{e), ^(a) = e as 
in the sub-critical case. But when ac < |y(e), ^(a) is a discrete random variable whose value is 
either e or the unique maximizer 2;o(ac) of inax^.g(c(a),oo) G{x;a) (which equals H(c(ac);ac) from 
the definition (|22]) ). 

For the rest of the paper, we assume that V is a potential such that 

ac ^ Jv (24) 

and 

for a G Jv \ {ad; max G{x]a) is attained at two points xi{a) and X2(a). (25) 

Moreover, we assume that 

G"(xo(a);a) / for a G (ac,oo) \ Jy, (26) 
G"(xi(a);a) / 0, G"{x2{a);a) / for a G \ {ad, (27) 
G"(xo(ac); ac) / for ac < ac. (28) 

Note that under this assumption, all of G"(xi(a); a) (i = 0, 1, 2) are negative. In [8], these excluded 
cases are referred as "exceptional cases". However, to be precise, even though it is reasonable to 
imagine that nonexceptional cases are generic in the sense of Kuijlaars and McLaughlin [19], this 
was not established in [8]. This issue will be considered somewhere else. 

The above conditions are trivially satisfied if V{x), x > e, is convex since in this case Jv = 0- 
We note that if V is such that Jv not empty, then it is easy to see that Jsv is also nonempty for 
real number s close enough to 1. Also it is easy to find an example of nonconvex potential V such 
that Jv / by considering a double-well potential. (See Remark 1.6 of [28].) 
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The analysis of this paper appHes to the excluded cases without much change but we do not 
include them here for the sake of presentation. 

We use the following notations for two intervals that appear frequently: 

/J:=[e + ^,oo), (29) 
T 

JI{x*) ■.= [x^+ =,oo), (30) 

^^ -G" [x^,)n 

for T G M and for > e, assuming that G"(x*) < in the later case. 
1.3 Statement of main results 

We now state the main results. The asymptotic results here are stated in some cases in terms of the 
distribution function ([8]) P^^]^ and in other cases in terms of the expectation ([7]) £d,n- This choice is 
simply to make the formula compact. The analysis applies to both quantities and indeed it is easy 
to deduce one result from the other from the relation ([8|) and the uniformity of the asymptotics in 
s near 1. We can also express all the results in terms of correlation functions but we find that the 
attention to individual eigenvalue is more illustrating in the current framework. 

We use the phrase that a limit holds "uniformly in s which is close to 1" in several places, for 
example in Theorem II. 21 This means that there exists a complex neighborhood of 1 independent of 
n in which the limit holds. A slightly more careful analysis would show that s uniformly converges 
in a larger domain (e.g., in any compact subset of C \ (1 + e, oo), e > 0,) but we do not discuss this 
issue in this paper. 

We state the results under the "genericity assumptions" (fM|) - ([28]) . in addition to the condi- 
tions (fT2]) - discussed in the last subsection. We group the asymptotic results into sub-critical, 
super-critical and critical cases. 

When d = n, we use the notation Fn^ for F^Jl^ and £n for £d,ni respectively. We also state the 
results only in this case. The case when d ^ n is similar. 

1.3.1 Sub-critical case 

The first result is on the sub-critical case when all external eigenvalues are smaller than the critical 
value SLc- In this case the external source does not change the location and the limiting distribution 
of the top eigenvalues. 
Let 

^^^^ ^^AiWAiM^M£)AiM 

x-y 

be the Airy kernel. For any T G R and s G C, set 

Fo{T; s) := det(l - sx[T,oo)^AiryX[T,oo)), (32) 
where xe denotes the projection on the set E. Then 



i\ ds^ 

1=0 



Fo{T;s) (33) 

s=l 
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is the Tracy-Widom j-th eigenvalue distribution. In particular, 



Fo(T) := F^'\T) = det(l - X[T,oo)AAiryX[T,oo)) 



(34) 



is the Tracy-Widom distribution. 

Theorem 1.2 (sub-critical case). Let ai, • • • , am be fixed numbers such that maxjai, • • • , am} < slc- 

Assume that ai, • • • , a^ are positive and distinct. Then for each T € 



uniformly in s which is close to 1. 

Remark 1.2. The assumption that ai,--- ,am are positive in Theorem 11.21 can be removed. The 
proof of the above theorem uses the calculations in [8] of the gap probability P.„_j+i^„(a; E) which 
are only detailed for a > 0. As suggested in [HI Section 2], there is a similar asymptotic result for 
P„_j_i_i^„(a; i?) for a < from which we can obtain the same result as the above theorem when 
some of aj's are not positive. This remark applies also to Theorem 11.31 below. 

Remark 1.3. The assumption that ai,--- ,am are distinct in Theorem 11.21 is technical and the 
result should hold without this assumption. The starting formula of the proof of this theorem 
is the identity (jlip . When some of a^-'s are identical, the right-hand side of (jlip becomes more 
complicated by using I'Hopital's rule. This in turn requires a more detailed asymptotic results 
for P„_j_|_i^„(a; i?). The analysis of Baik and Wang [8] can be extended for this but we do not 
pursue this in this paper for the sake of space and presentation. The same remark applies to all 
other theorems in this section. It is interesting to contrast this situation to the papers [TT] and 
|12j which analyzed the similar model using the Riemann-Hilbert problem for multiple orthogonal 
polynomials. In that approach, the case in which all a^-'s are identical is the simplest to analyze. 

1.3.2 Super-critical case 

In this section we consider the super-critical case in which some of the external source eigenvalues 
are strictly larger than the critical value slc- In this case large external source eigenvalues do have 
an effect on the top eigenvalues. We consider three sub-cases. In the first two cases, we assume 
that aj ^ for all j. The first among these is the case when aj are separated by 0(1) distances. 
In the second case, the external source eigenvalues are asymptotically the same. The third case is 
the secondary critical case when aj are all asymptotically equal to some a G ^TV \ {ad. From the 
discussion of Section [L2l the last case does not occur if V{x) is convex for x G [e,oo). 



lim £'„(ai, • • • 



(35) 



Let 




(36) 



be the c.d.f. of the standard normal distribution. 
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Theorem 1.3 (super-critical case 1: separated external source eigenvalues). Let ai,--- ,am be 

fixed positive and distinct numbers. Suppose that there is p £ {!,■ ■ ■ , m} such that 



a,- > a.c for j = 1, • • • ,p, and a,- < a.c for j = p + 1, ■ ■ ■ , m. 



(37) 



Assume, without loss of generality, that ai > a2 > • • • > a^. Suppose that aj ^ J^y and 
G"(xo(aj)) 7^ for each j = 1, - • • ,p. Then for each T G M and j = 1, • • • ,p, 

(38) 



(39) 



lim P(f)(ai, • • • ,a^; jJ(xo(a,))) = G{T), 



where Jj(x*) is defined in (j30|) . We also have, for j = 1,2, 



lim P(f+^)(ai,... ,a^;Z^))=F(^)(T), 



where Fq\t) is the Tracy-Widom j-th eigenvalue distribution defined in (j33p . 

Theorem 11.31 demonstrates that each of the external source eigenvalues which is greater than a^ 
pulls exactly one eigenvalue out of the support of the equilibrium measure. The limiting location 
of each pulled-off eigenvalue depends only on the corresponding external source eigenvalue. The 
fluctuation of each pulled-off is Gaussian. The rest of the eigenvalues are unaffected by the external 
source eigenvalues asymptotically. 

We now consider the situation when the external source eigenvalues are asymptotically the 
same. A non-Gaussian fluctuation appears when they converge together in a particular fashion. 
Define, for distinct ai, • • • , Ofc, 



det 



Gfc(r;ai, • • • ,ak;s) 



IZo x-ie-''/2+".-(l - sxiT,^){x))da 



l<i,j<k 



det 



J — oo 



(40) 



l<i,j<k 



Observe that 

Gfc(T;Qi,--- ,afc;s) =£k,i{ai,--- , a/,; [T, oo); s), (41) 

in terms of the notation ([7|) when V{x) = in ([5|). Hence Gk{T; ai, • • • , a^; s) is an expectation 
that arises from the kxk Gaussian Unitary ensemble (GUE) with external source diag(ai, • • • , am)- 
As a special case. 



(-1)* d' 



1=0 



i\ ds^ 



Gk{T;0,--- ,0;s) 



(42) 



s=l 



is the c.d.f. of the j-th largest eigenvalue of the fc-dimensional GUE. When j = k = 1, this equals 
G{T). 

Theorem 1.4 (super-critical case 2: clustered external source eigenvalues). Let a be a fixed number 
such that a > a-c, a ^ Jy and G"(xo(a)) ^ 0. Set 



afc = a + ^/-G"{xQ{a)) 



oik 



n 



k = l,' 



, m. 



(43) 
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for fixed distinct ai, • • • , a^. Then for each T G M, 

lim .^^(ai,-- - , am; jJ(xo(a));s) = Gm(r; ,ain]s) (44) 

n— >oo 

uniformly in s which is close to 1. 

Hence in this case the m eigenvalues which are outside of the bulk converge to the same location 
XQ{a). After a scaling, they fluctuate as the eigenvalues of m x m GUE matrix with external source 
diag(ai,--- ,0^). 

Remark 1.4. We can also consider the general case that for 01,02,- •• > ac where aj ^ and 
G"(xo(oj)) / 0, pi external source eigenvalues are close to oi, p2 external source eigenvalues are 
close to 02, etc. Then for each j, pj eigenvalues converge to xo(oj) and they fluctuate like the 
eigenvalues of pj x pj GUE with certain external source. This can be obtained by combining the 
proofs of Theorem 11.31 and 11.41 but it is tedious. We omit the proof. 

Remark 1.5. In Theorem 11.41 we can also prove the analogue of (j39p and show that for each 
j > 1, the (m + j)-th eigenvalue converges to e and its limiting distribution is the Tracy- Widom 
j-th. eigenvalue distribution defined in (|33p . Similar remark also applies to Theorem 11.51 and to 
Theorem 11.71 below. 

We now consider the situation when all external source eigenvalues are near or at a secondary 
critical value of V. In this case, we will state the result under the assumption that the support 
of the equilibrium measure of V consists of one interval (i.e. = in ()15p ). This assumption is 
made only for the ease of statement: see Remark 1 1 . 6 1 b elow how the result is changed if A > 0. 

Let o S J'v and we consider the situation when m external source eigenvalues converge to a. 
Under the assumption ([25]) . the top m eigenvalues converge to one of the two possible locations, 
which we denote by xi{a) < ^2(0). How many of the eigenvalues converge to each of them? It 
turned out that any number is possible and it depends on how fast the external source eigenvalues 
converges to o. There are m distinct scalings. To each scaling indexed by an m G {1, • • • ,ni} a 
number pm G (0, 1) is associated such that either one of the following two happens: with probability 
Pm, the top m — 1 eigenvalues converge to ^2(0) and the next top m — ?n + 1 eigenvalues to xi{a), 
or with probability 1 — pm, the top m eigenvalues converge to ^2(0) and the next top m — m 
eigenvalues to xi(o). In order to describe Pm, we need some definitions. 

Since we assume A = 0, the support J of ^{x) is of form J = (e,e). Set 7(2) := (frf)^^^ 
which is defined on C \ [e, e] and satisfies 7(2;) ~ 1 as z — t- 00. Define, for j G Z, 



for z in C \ (—00, e]. For j = 0, • • • , m and for distinct a,b G (e, 00), we define the matrix 



{a,m-j),{b,j) ._ 



(46) 
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We show in Proposition 17. l|(b)] that the determinant of ^p^"'"" is nonzero and (— 

times the determinant is positive if a < 5. We also define, for c 7^ and distinct real numbers 

Cti , • • • , Ctni; 



^J{0,m-j),(cJ)(«l5 • • • > "r 



1 ai 



1 Or 



m-j-l 



pCai 



ai e 



,cai 



(47) 



where j = 0, 1, • • • , m. Note that (-l)'"^"'"^)/^ det[n(o,m-j),(cj)(ai, • • • ,am)] > if c > and 

«!>•••> Om- 

Theorem 1.5 (secondary critical case). Assume that the support of the equilibrium measure asso- 
ciated to V consists of one interval. Let a be a secondary critical value (i.e. a £ Jy \ {ad ) such 
that G{x;a), x G (c(a), 00), attains its maximum value at two points xi{a) < 3:2(0). Assume that 
G"{xi{a); a) / and G"{x2{a); a) ^ 0. Fix m € {1, 2, • • • , m}, and set 

m — 2m + 1 



and 



K ■- 



X2[a) - xi{a) 
'(m-m)! (-G"(xi(a)))'"-'"+V2\ — 



(m-1)! (-G"(2;2(a)))"^-i/2 
Suppose that the external source eigenvalues are 

k = 1 



aj^ = a 



logjKmn) Ok 
n n 



(48) 



(49) 



(50) 



for fixed distinct ai > ■ ■ ■ > a^. Then for any T € as n —t- 00 we have the following, 
(a) For k = 1, - ■ ■ ,m — 1, 

P(f )(ai, ■ ■ ■ , a^; Jj(x2(a))) = p^gL'^(T) + (1 - p™)GW(r) + o(l). 

f6j For k = m, 

P(f)(ai, • • • ,a^; Jj(x2(a))) =p„ + (1 - p™)G(:^)(T) + o(l), 
P(f)(ai,... ,a„; Jj(xi(a))) =p„,G;iL„_,i(r) + o(l). 

f'cj For /c = m + 1 , ■ 



, m, 



ai, • . • ,a^; jj(xi(a))) = P™G(^:"+l^(r) + (1 - p„)gS::::) (T) + o(l) 



Here Pm a number in (0, 1) defined by 



Pm : 



det[Pm-i] det[Qm-i] 



det[P„_i] det[Q^„i] + det[P„] det[Q, 



(51) 

(52) 
(53) 

(54) 
(55) 



where := *P 
.{I 



{xi {a),m—£),(x2ia)/) 



an. 



d Qi := 0.{o,ni-£),ix2ia)-xiia),£)iai,- ■ ■ ,am)- The function 



G^j^\t) is the distribution function of the £th largest eigenvalue of k x k GUE defined in (j42p . 
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Observe that one more eigenvalue is pulled off from xi{a) to X2{a) as m increases by 1. The 
eigenvalues clustered near each of xi{a) or X2{a) fluctuate like the eigenvalues of a GUE matrix of 
dimension equal to the cluster size. 

Note that Pm is well defined even for nondistinct cxj if we apply I'Hopital's rule to the right-hand 
side of (i55]l . The theorem holds without the assumption of distinctness but we do not pursue it 
here. See Remark 11.31 

Remark 1.6. When the support of equilibrium measure associated to the potential V consists of 
more than one interval (i.e. > 0), the above theorem still holds after one change: the probability 
Pm depends on n. In the formula (|45|) . Aij needs to be changed to Mj^n in IS Formula (311)], 
which is expressible in terms of a Riemann theta function and depends on n quasi-periodically. 
Nevertheless, it can be shown that lies in a compact subset of (0, 1) for all large enough n from 
Proposition 17. 1[ This is enough to extend the proof of the above theorem from = case to 
iV > case. 

1.3.3 Critical case 

The final two theorems concern the critical case. In this case the limiting location of the top 
eigenvalue(s) is about to break off from e. Recall that the critical value slc which is determined 
by the potential V satisfies slc < ^V'{e). Depending on whether slc = ^^'(e) or slc < ^^'(e), 
the break-off is continuous or discontinuous. When V{x) is convex in x G [e,oo), we always have 
Sic = ^^'(s) and the break-off is continuous. 




Figure 1: The contour of the integral in (j56p 

Let us define the limiting distributions that appear in the case when ac = ^V'{e). For a G M, 
define the function (see [U Formula (15)] and [HI Formula (18)]) 

CaiO ■■=^ [ e^¥'+'^^^^, (56) 
ZTT J a + iz 

where the contour is from ooe^'^*/^ to ooe'^*/^ and the pole z = —ia lies above the contour in the 
complex plane (Figure [1]) . Set for T G E and s G C 

Fi{T-a;s) :=Fo(T;s)- |^1 - s((l - sx[T,oo)^AiryX[T,oo))""^Ca, X[t,oo) Ai)^ , (57) 

where {f,g) denotes the real inner product over M, J^f{x)g{x)dx. For k > 1 and distinct real 
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parameters ai, • • • ,ak, define 



det 



Fk{T;ai, ■■■ ,ak;s) := Fo{T;s) 



(a I d y-l F,{T;a;s) 



l<i,j<k 



n 



l<i<j<k\'^j ^i) 



(58) 



When s = 1, the function Fi(r;a;l) was defined in [U Definition 1.3] and Fk{T;ai, - ■ ■ ,afc;l) 
was introduced in [21 Theorem 1.1]. They are known to be distribution functions and can be 
expressed in terms of Painleve II equation and its Lax pair equations. It is also known that 
Fi(T;0;l) is the square of the GOE Tracy-Widom distribution (see [U Formula (24)]). (The 
function Fk{T;ai, - ■ ■ ,Qfc;l) is shown to be the limiting distribution of the largest eigenvalue in 
the spiked model of rank k at the critical case for the potentials V{x) = {{1 + c)x — clog x)x(o,oo){^) 
and V{x) = x'^/2 in [3] and [23], respectively. It is easy to check from the determinantal point 
process structure that 



^(i)^rr. N SA (-1)* 



i=0 



(59) 



s=l 



is the limiting distribution of the j-th largest eigenvalue in these potentials even though this was 
not discussed in [il [23].) 



Theorem 1.6 (critical case 1: continuous transition). Suppose that V is a potential such that 
slc = ^V{e) and slc ^ -Jv- Suppose that 



a.k = ac + 



n 



1/3^ 



, m, 



for distinct real numbers ai, • • • , Om- Then for each T G M, 

lim f„(ai,-- - ,am;/J;s) = F^{T;-ai, - ■ ■ 
uniformly in s which is close to 1. 



-Or 



(60) 



(61) 



We now consider the case with potential V such that a.c < ^V'{e). As usual, we assume 
&c ^ iJv- As in Theorem 11.51 above, we also assume, for the ease of statement, that the support of 
the equilibrium measure of V consists of a single interval. An analogue of Remark 11.61 applies to 
the multiple interval case. 

Define (cf. for j £ Z. 



7(z) -7(2) ^ f l{z)-l{z) 



7r(e — e) 



-2i 



1\ ~3 



7(z)+7(2;) 1 



z gC \ (-00, e]. 



(62) 



Note that —iMj{x) > for x G (e, 00). For j = 0, 1, • • • , m and a,b £ (e, 00), we define, similar to 
(1461) ■ the matrix 



{b,j) 

{a,m-j) 



Mi{a) M[{a) ■■■ M^^~^~^\a) Mi{b) M[{b) 



MM M'M ••• M 



(m-j-l) 



M['-'\b) 



(a) MM M'M ■■■ M^^^'\b) 



(63) 
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Also recall the matrix Q(o,m-j),(c,j)(Q^ii " " " i Qim) defined in (|17|) 

Recall the point xo(ac) which is well defined when ac < ^V'{e) from Section [L2l Note that 
rco(ac) > c(ac) > e. The point a;o(ac) is unique when ac ^ Jv- 

Theorem 1.7 (critical case 2: jump transition). Lei y &e a potential such that slc < ^V{e). 
Assume that ^ J^v o-i^d G"(xo(ac); ac) 7^ 0. Fix m G {1, 2, • • • , m} and suppose that 

afe = ac - gm ^"^^"^"'^'' + — , = 1, • • • , m, (64) 
n n 

/or distinct «!>•••> where 

m — 2m + 1 



a;o(ac) - c(ac) 



(65) 



and 



- _ (m - my. {u"ic{a,))r^^+y^ \ 

l^(m-l)! (-G"(xo(ac)))-V2 J • ^^^^ 

Assume the support of the equilibrium measure of V consists of a single interval. Then for any 
r G M, as n — )• 00 we have the following. 

(a) For k = 1, - ■ ■ , m — 1, 

pW(ai,... ,a^;4^(xo(ac))) =p™,GS^i(r) + (l-p^)GW(r)+o(l). (67) 

(b) For k = m, 

(ai,--- ,a„,;jJ(xo(ac))) =p™ + (l-p^)G(r)(r) + o(l), (68) 
P(f)(ai,--- ,a„,;/J) =p^Fo(r) + o(l). (69) 



Here 



det[P„_i]det[Q 



m— Ij 



^ — , (70) 
det[P„„i] det[Q^_i] + det[P^] det[Q„,] 

where Pe := (-0'""^*P(c{ar)!m-^) '^^'^ ^(o,m-£), (x'o(a,)-c(a,),£) («!,•• • ,am)- i^or eac/i ^, 

detpf] det[Q^] > 0, and hence pm S (0,1). The distribution functions G^^\t) are defined in 
([12|) . and Fq(T) is the Tracy-Widom distribution in ([M]) . 

Hence in this case, some eigenvalues are pulled off the edge of the equilibrium measure and 
fluctuate as the eigenvalues of Gaussian unitary ensemble. The largest eigenvalue which is not 
pulled off the edge of the equilibrium measure fluctuates as the Tracy-Widom distribution. 

It can also be shown that the (m + j)-th eigenvalue has either the Tracy-Widom (j + l)-th 
eigenvalue distribution, or the Tracy-Widom j-th eigenvalue distribution as its limiting distribution, 
with probability pm and 1 — pm, respectively. 

The proof of this theorem is very close to the proof of Theorem 11.51 and we skip it. 

Remark 1.7. In this paper we state only limit theorems for individual top eigenvalues. The analysis 
of this paper can be modified to obtain the limit theorems of joint distribution of top eigenvalues. 
The result is what one would expect. We skip the detail. 



14 



1.4 Comments on the proofs and organization of the paper 

We prove the asymptotic results in Section 11.31 based on Theorem 11.11 and extensions of the asymp- 
totic results for the rank one case of [8]. The latter are mostly routine and we do not give full 
details. In employing the above strategy to prove Theorems ll.2l and ll.3l we need to prove the limit 
of the determinant in the denominator of (|lip is nonzero. This is done in Section [71 The proofs of 
Theorems 11.41 [T3] and [L71 are more complicated since the denominator of (jlip converges to zero and 
hence we need to show that the numerator and the denominator have the same vanishing factors 
in their asymptotics. This requires careful linear algebraic manipulations. After factoring out the 
vanishing term, the denominator converges to a certain determinant which we show again nonzero 
in Section [71 The proof of Theorem 11.61 also follows this general strategy but we use a variation of 
Theorem 11.11 and the analysis is more involved. We skip the proof of Theorem 11.71 since it is very 
close to that of Theorem 11.51 

The rest of the paper is organized as follows. Theorems I1.2H1.6I are proved in the Sections [IHSl 
respectively. As mentioned in the above paragraph, in the proofs in these sections, we need to show 
that a certain determinant is nonzero. This is done in Section [71 in a unifying way. The algebraic 
theorem. Theorem I l.H that relates the higher rank case to the rank 1 case is proved in Section [HI 



2 Proof of Theorem II. 2t sub-critical case 

Recall that the sub-critical case is when 

max{ai, • • • , am} < ac. (71) 

We also assume that a^'s are all positive, distinct and fixed. In order to use Theorem ll.il we need 
the asymptotics of r„_j(afc;n) and ^„_j+i,„(afc; /J; s) = ^"^'s^^^I^I^t'I^'''' ■ 

Asymptotics of r„„j(afc;n) 

From [SI Formula (92)] we have for all a G (0, ac) 

Tn-j{a;n) = (7(a)7W,- „(c(a))(l + o(l)), (72) 

where 

, pnH(c(a);a) 

C(a) := -^Jg^e-"^/^-^ (73) 
V n VH"(c(a);a) 

and Mj^n{z) is a generalization to Aij{z) in (|62|) when the support of the equilibrium measure 
is a multi-interval (i.e. A'^ > 0). The function Mj^n{z) can be found in terms the solution to a 
global Riemann-Hilbert problem in the analysis of orthogonal polynomials and is given explicitly 
in terms of a Riemann theta function, see [HI Formula (312)]. Unless A^ = 0, Aij^n{z) depends on 
n. However it is uniformly bounded in n, together with its derivatives, in any compact subset of z. 
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Asymptotics of £:„_j+i,„(afc; /J; s) 

Recall from the usual invariant ensemble theory that (see e.g., [26]) 

£n-j+l,n{^'^ = det(l - SXEKn-j+l,nXE), (74) 

for any set E cM., where Kn-j+i,n is the standard Christoffel-Darboux kernel for the weight e~"^ 
(see e.g., (HI Formula (69)]). For E = , the asymptotic result on invariant ensemble implies that 
XiTKn-j+i,nXiT converges to X[T,oo)-^AiryX[T,oo) trace norm for each fixed j ([E], [15], see also 
[8l"Corollary 6.3]). Thus 

det(l - SXlTKn-j,nXlT) = det(l - SX[T,oo)^AiryX[T,oo))(l + «(!)) (75) 

and by (f32]l 

£n-j+l,n{In; = s){l + o(l)). (76) 

For the rank 1 case, the analogue of ()74p is (see [HI Formula (73)] (Only the s = 1 case is given 
in |8] but the same proof works for general s ^ 1.)) 

Sn-j+l,n{a; E; s) = det(l - SXEKn-j+l,nXE) (77) 

where Kn-j+i^n = Kn-j^n + V'n-i ® i^n-j- Here ipn-j is the orthogonal polynomial times and 
Mx) = Mx; a; n) := — ^ Lnia.-Vix)/2) _ f ^^^^ y)e-y-^(y)dy] . (78) 
This implies that, for E C M, 1 — sxEKn-j,nXE is invertible, 

£n-j+l,n{"'; E; s) = det(l - SXEKn-j,nXE)[^ - s{lpn-j,XE'4'n-j) 

- ■S^((l - SXEKn-j,nXE)~^XEKn-j,nXE'fpn-j,XEi^n-j)]- (79) 

For E = I^, 1 — sxEKn-j,nXE is invertible for all s close enough to s = 1. (This is be- 
cause XEKn-j,nXE Converges to X[T,oo)-^AiryX[r,oo) i'^ operator norm when E = and since 
X[T,oo)-^AiryX[r,oo) h^s its spectrum in [0,1). This appears in several places in the subsequence 
sections and we do not repeat this remark.) When E = ll^ and a G (0, ac), the asymptotics of (f79]l 
for s = 1 was obtained in [8l Section 3.3] by analyzing each term on the right-hand side. It was 
shown that both inner products are 0{n^/^) (see [H Formulas (128), (131) and (332)]). Hence 
from ()75p we find that 

£n-j+l,n{a] /J; S) = det(l - SX[T,oo)^AiryX[T,oo))(l + o{l)) = Fq{T; s)(1 + o(l)). (80) 

Combining (fTHI) and (|80l) we obtain, for a G (0,ac), 

4-i+i,n(a;/^;s) = 1 + 0(1), (81) 

uniformly in s which is close to 1. 
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Inserting (jST]) . (j72|) and (j76|) into the formula (|TT|) . we obtain 

,T , det[>f,>(c(afc)) + o(l)]^?-,^ 



det[A^j-„(c(afc)) + o(l)] 



(82) 



j,k=i 



Since A4j^„(c(a/(.)) are bounded uniformly in n and the reciprocal of det[7Wj_„(c(afc))] is bounded 
uniformly in n by Proposition I7.]|(a)| the ratio of the two determinants in (|82p is 1 + o(l). Hence 
we obtain Theorem 11.21 

3 Proof of Theorem II. 3t super-critical case 1, separated external 
sources eigenvalues 

Recall that we assume that there exists p G {1, • " " ) ^} such that the positive, distinct and fixed 
numbers 

a,- > a^ for 7 = 1, • • • ,p, 

' \ . / (83) 

aj < ac tor J = p + 1, • • • , m. 

We assume, without loss of generality, that ai > a2 > • • • > ap. Furthermore, we assume that 
aj ^ Jv and G"{xQ{a.j)) / for each j = I,-- - ,p, where xo(a) is defined in the paragraph 
between ([23]) and ^ in Section O 

To use Theorem II. 11 we need the asymptotics of r„_j(afc; n), £n-j+i,n{^k'-, E; s), and £n-j-\-i{E; s) 
for E = and E = jj(x*) with x* > e. 

Asymptotics of r„_j (a; n) 

By Baik and Wang [U Formula (93)], we find that if ac < a < ^V'{e) and a then 

Tn-jia;n) = C7(a)A^,- „(xo(a))(l + o(l)), (84) 

where 

V n ^-G"(xo(a);a) 

and A^j^„(-2) is a generalization of 7Wj(2;) in (j45p when the support of the equilibrium measure is 
multi- interval (i.e., > 0). This again can be expressed explicitly in terms of a Riemann theta 
function; see [H Formula (311)]. Note that Aij^n{z) depends on n but is uniformly bounded in n, 
together with its derivatives, in any compact subset in z. For a > iy'(e), we have the asymptotics 
O Formula (188)] of Tn-j{a; n) which is an intermediate step toward the formula It is easy to 
further compute the formula [H Formula (188)] asymptotically (using the asymptotics of ipn-j{y)) 
and we find that ([8^ also holds for a > ^V'{e). The same applies to the case when a = ^V'{e) > slc 
from the remark in the first paragraph of Baik and Wang [HI Section 5]. In conclusion, the formula 
is valid for all a > slc and a J^y- 
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Asymptotics of £:„_j+i,„(afc; s) and £n-j+i{J^{x^)] s) for > e. 

Since x* > e, the ChristofFel-Darboux kernel restricted on converges to rapidly (see e.g. 

[HI Formula (346)].) Hence we find from ()74p that 

8n-j+l,n{jl{^*)\ S) = l + o(l) (86) 

for all > e, T G M and s close to 1. 

We now evaluate i5.„_j+i^„(a; jj(x*); s) for a = slj. From the assumption (|83l) . there are two 
cases. The first is when a > ac and a ^ and the second is when a < slc. The formula (I79p is 
the starting point. 

Let a > a.c and satisfy a ^ J'y. For x* = xo(a), the asymptotics j8l Formula (137)] implies that 
' XjT(xo{a))'^n-j) equals 1 — G(T)+o(l) where G{T) is the c.d.f. of the normal distribution ([Si])- 
The estimates [U Formulas (139) and (333)] implies that the other inner product is o(l). Therefore, 
we find that 

£n-j+iAa; jJ(xo(a)); s) = 1 - s(l - G{T)) + o(l) (87) 

uniformly in s close to 1. The estimates [HI Formulas (137) and (139)] can be extended straightfor- 
wardly to the set jj(x*) for x* not equal to xo(a) but still in (e, oo). Hence we obtain 



1 + o(l), X* > xo(a), 

l-s + o(l), X* G (e, xo(a)), 



uniformly in s close to 1. This is what is expected from (j87p by taking T = oo for the first case and 
taking T = — oo the second case. Recall that these asymptotics are for a > a.c such that a ^ JV- 
The asymptotics (f87|) and ((88]) apply to ai, • • • , a^. 

On the other hand, for a < ac, an estimate similar to ()80p implies that (note that jj(x*) C 
for any x* > e, ([80]) and Fq{T; s) — )• 1 as T — )• oo) 

£n-j+i,n{a; JIM; s) = l + o(l) (89) 
for s close to 1. This asymptotics applies to ap+i, • • • ,ain. 

Now inserting the asymptotics ([72]), ([HID, ([HS]), ((HZj), dMI) and ((HSj) into ([II]), we obtain, for each 
k = !,■■■ ,p, 

in(ai,--- ,am; J„, (xo(afc));s) = det[y + o(l)] ' ^ ' 

where 

"A1i,„(xo(ai)) ••• A4i,„(xo(ap)) A^i,„(c(ap+i)) ••• 7Wi,„(c(am)) 



.A^m,n(2;o(ai)) ••• A^m,n.(2;o(ap)) A^m,n(c(ap+i)) ••• Mm,n{c{a.^))_ 



(91) 
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The matrix ^ is the m x m matrix defined in (j227p up to column changes and hence the reciprocal 
of det[^] is bounded uniformly in n by Proposition I7.]](a)[ Since the entries of '^J are bounded 
uniformly in n, we find that 



Snisii,--- ,a^;jJ(xo(afe));s) = (l-s + sG(r))(l-s)^-i+o(l) (92) 



uniformly in s close to 1. 
For each j > 0, 



ifj/A;-l,A:, 
(1 _ , + sG{T)){l - = <! G{T) if J = A: - 1, (93) 

1-G{T) \ij = k. 



Since the left-hand side of ([92]) is analytic in s, we obtain ([38|) by taking derivatives and using ([8]). 
Asymptotics of £:„_j+i,„(afc; ij; s) and £„_j+i(lj;s) 

To prove ([39]) . we repeat the above computation with jj(a;*) replaced by /J. Let a > ac and 
assume a ^ Jy- Using asymptotics [51 Formulas (330) and (331)] of -0, asymptotics [51 Formulas 
(106) and (135)] of i/' and asymptotics [51 Corollary 6.3] of Kn-j,n, by ([7^ we have that for s close 
to 1 (cf. (IMD with x., < xo(e)) 

£n-j+iA(^; In-, = det(l - sxiTKn-j,nXiT)il " s + o(l)) = Fo(r; s)(l - s + 0(1)). (94) 

Hence by (|76p we have for s close to 1 

'fn-i+i,n.(a; /J; s) = 1 - s + o(l). (95) 

This asymptotics and (j84p are for a = ai, • • • , ap. 

For a = ap+i, • • • , am which are all less than a^ we can use the asymptotics (j72p and (jSip . 
Inserting them into (jlip . we obtain for s close to 1 

£:„(ai, . . . , am; Ij; s) = ^^^^i^^J^^^PoiT; s) = {l- sfFoiT; s) + o(l) (96) 

where ^ is same as (|9ip . We obtain (|39p by taking derivatives on both sides of 



4 Proof of Theorem 11.41 : super-critical case 2, clustered external 
source eigenvalues 

Let a be a fixed number such that a > ac and a ^ J'y. Recall the definition XQ(a) given in the 
paragraph between ([23]) and (p^ . As usual we assume that G"{xo{a)) ^ 0. Set 

afe = a+ V-G"(xo(a))^, A; = l,---,m, (97) 

for fixed distinct ,Q;ni- To prove Theorem 11.41 we first evaluate the denominator of (jlip 

asymptotically and then the numerator when E = jJ(xo(a)). 
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4.1 Evaluation of det [r„_j(afc; n)] 

The asymptotics of r„_j(o) were evaluated in [8l Formula (93)] when a is a constant. It is easy 
to see from the proof that [HI Formula (93)] is indeed uniform for a in a compact subset of (ac, oo) 
which is especially applicable when a^ given by (j97p . It is clear that the leading-order asymptotics 
of 

Tn— j(3-fc) sre same for all k — I,'"" , m. This implies that the determinant det[r^_j(afc)]^_j^ 
converges to zero. Therefore, we need to evaluate the sub-leading terms in the asymptotics of 
Tn-j{sLk) in order to determine the asymptotics of det[r„_j(afc)]^^^^. 

The formula of r„_j(afc) in (jlOp is in terms of an integral over M. This integral can be written 
as a sum of two integrals, one over a contour T± in a complex plane and the other over the segment 
(c, oo) for any constant c > e (see [HI Formula (85)]). For the case at hand, the integral over 
the contours T± was shown to be exponentially smaller than the integral over (c, oo), and the 
main contribution to the integral over (c, oo) comes from a small neighborhood of the critical point 
X = xo(a). Hence from [SJ Formula (90)] we have, for any e > 0, 



i'Xo{a)+e 

Tn-j{^u) = e-"'/' / M,>(y)e"«(^'^'=)dy(l + 0{e-'^)) (98) 



for some 5 > Q. Here G(i/; a) is the function defined in (j2ip and Mj^n{z) is an analytic function in 
a neighborhood of z = xo(a). 
By Taylor expansion, 

m 

^^■.-(^) = E 7— Tv4n - + 0{\z- xo(a)r) (99) 

uniformly for z in a neighborhood of xo(a), where Afj*„ is the (i — l)th derivative. As re — )• oo, 
Mj^n{z) = A4j^n{z){l + 0{n~^)) uniformly in z in the same neighborhood for another analytic 
function M^j^n{z) which depends on quasi-periodically in n. (See [HI (319)]. This Mj^n{z) is the 
same Mj^n{z) appearing in (j84p .) A key property for our purpose is that a certain determinant 
involving Mj^n and its derivatives is nonzero, which is proved in Proposition I7.]](b)| later. This is 
used when we consider det['P] and det['P] below. Note that 

Mf-^\x,{a)) = M^;-'\x,{a)){l + ©(re"^)) (100) 

since both functions are analytic. Each of ^^(^o(o)) and M^^- j^^\xQ{a)) are 0(1). 
Inserting ([99]) into ([98]) . we find 

r„_, (a,) = e««(-(«)-)-^/^ {± ^-'^"^f^~^'\ l'^ix,{a^Q(^, k) + n-^Rij, k)^ , 

(101) 

where 

/•xo{a)+€ 

Q{i,k) := {-nG"{xoia);a)y^^ / (y - xo(a))^-^e'^(^(^'^^)-^(^o('^);^'=))dy (102) 

Jxo{a)-t 
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and 



\ J X 



xo{a)-e 



+ 



xo{a)+t 



XQ{a)-e 



From the definition of G and ([9 



G(y;afc) = G{y;a) + auy 
Hence Laplace's method yields 



-G"(xo(a);a) 



n 



/oo 
r^^e-i«'+"^«d^(l + o(l)). 
-oo 



Similarly, we find 



/.zo(a)+e 

R{j,k) = 0[n— 



Jxo(a)—t J 



Denote the m x m matrices 



V 



(104) 



(105) 



(106) 



(107) 



Note that all entries of these matrices are 0{1). We also set to be an m x m diagonal matrix 
with entries 



Wu = J—Yy_{-nG"{xo{a)-a)) 



-i/2 



(108) 



From (jlOip . we have 
det [Tn-Mk]n)]'f,^ 



,nG(xo(a);afc)-n^/2 



dei[VMQ + n 



n 

\k=l / 
^ m \ 
-Q gn,G(xo(a);afe)-ni/2 det[PQ + n-'^VN-^p-^U] 



(109) 



if V is invertible. 

We now replace V and Q by matrices with entries given by the leading terms given in (jlOOp 
and (I105|) . Define the m x m matrix 



V 



-M£'^(xo(a)) 



(110) 



The entries of this matrix are the leading term of the entries of the matrix V (see (jlOOp ). From the 
general result Proposition I7.l[(b)] and by noting that V = <p(^o('^)''") in the notation of Section [3 
we find that det['P] is nonzero. Moreover, 1/ det['P], which depends on n, is uniformly bounded. 
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This nonvanishing property is easy to check directly using the formula (j45p when = but is 
complicated when > 0. Now as "P = "P + o(l), we find that all entries of are 0{1). Hence 
noting that the explicit dependence on n of A/", we find that all entries of n ~'PM~^V~^TZ are 
0(n-i/2). 

We also define 



Q 



(111) 



i,k=l 



Then Q = Q + o(l). Therefore, we find from (fTUU]) that 



det [r„_,(a,;n)]-^i = ne" 



G(xo(a);afc)-nf/2 



det[AA](det[P] det[Q] +o(l)). 



(112) 



fc=i 



It is straightforward to check that 



„ n 

det[Q] = / detK^«^] T\{ij - ii) n e-^^'d^ ■ ■ ■ d^. 



(113) 



and this is nonzero when all a^'s are distinct. 



4.2 Evaluation of det [r„_j(afc; n)8n-j+i,n{,Sik; J^{xo{a)); s)]™ 



Note that since SLk > a^, the asymptotics (|86p applies. Hence from the definition ([9|) of wc find 
that 



det [r„_j(afc)<S„_j+i,„(afc; jJ(xo(a)); s 

, £n-j+l,n{^k; Jn{xo{a)); s) 



det 



det 



m 

hk=l 

m m 



n—j,n 



(Jj(xo(a));s) 



n 



<gn-j,n(Jj(a:o(a));s) 
i,n(-'J(a;o(a));s) 



(114) 



(afe) 



gn-j+i,n,(afc; J„ {xo{a)); s 
(Jj(xo(a));s) 



n—j,n 



(1 + 0(1)). 



We focus on the new determinant. As in the previous subsection, the determinant converges to 
zero and hence we need to find the leading asymptotics. 
Prom dZH), and (UH), we find 



Sn~j+l,n{^k'i s) 
£n—j,ni,'E/^ s) 



1 - s{'^|Jn-jix■,a.k■,n),^pn-j)E 

- S^{{1 - SXEKn-j,nXE)~^XEKn-j,nXE4'n-j{x;a.k;n),^n-j)E, (115) 



with E = {xo{a)). Note that the interval E = jJ(xo(a)) is associated to a and ipn-j is associated 
to afc. When a and a^ are the same and larger than e, the second inner product was shown to be 
exponentially small in [8]: precisely in [8l Formula (139)] assuming a < ^V'{e) and in [H Sections 
4 and 5] when a > ^V'{e) and a = ^^'(e). In our case, a^ and a are different, but note that the 
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difference is 0{n ^/^) by assumption (j97p . This corresponds to a small change in the domain of 
the inner product which does not change the exponential decay of the inner product. Thus we have 

— ' 'jrp, , . = 1 -s('0„-j(x;afc;n),'i/'„_j(x;n))jT(^^(^)) +0(e " (116) 

for some 6' > uniformly for s close to 1. 

Now we evaluate the remaining inner product in (1116^ . We actually evaluate the inner product 
multiplied by r„_j(afc; n), which is what we need in view of (jllSp . The leading-order asymptotics of 
this quantity was evaluated in [HI Section 3.4]. Here we need the sub-leading terms and this follows 
from a simple extension of the analysis for the leading term as follows. First, for all x G J^{xQ[a)), 
we have from [HI Formulas (106) and (330)] that 

r„„,-(afc;n)Vi„-j(x;afc;n)V'n-,-(x;n) = e-^^/^M,- „(x)e"«(^'-^)(l + ©(e"^"")). (117) 

for some 5" > 0. This is same as [El Formula (136)] (after substituting the asymptotics of Tn-j) 
where the error term is written only as o(l) instead of an exponentially small term. Recalling that 
G{x;a), X G (e, oo), takes its unique maximum at x = a by the assumption a > slc and a ^ Jy, 
and noting that G(x;afc) is close to G(x;a) (see ()104p ). we find that for any e > 

Tn-jia-k] n){i)n-j{x; afc; ?i), ^„_j(x; n)) jT(3,^(„)) 
= ( e""'/' / M,^^{y)e-''(y^^^~^dy\ (1 + 0(6"^"")) 

= ( e-"^/2 f M,-,(2/)e"^(^''^^)dy) 1 (1 + 0{e-'"'^)) 

for some S" > where ET,t{xo{a)) is the interval 

ET,eiMa)) ■■= I xo(a) + ^= J , xo{a) + e] . (119) 

V \/-G"(xo(a))n / 



We now find from (fTTU|) . (1^51) . and (fTTHD that 
(afc; Jj(xo(a));s) 



£n-j,n{Jn{xo{a)y,s) 

^-ni/2 r^''^^' M,-„(2/)e"«(j^^-'=)(l - sxErAMa))iy))dya + ©(e"^'^)), (120) 

J xn(a) — e 



where 5 = mm{6,6"'}. This formula is completely analogous to (j98p in the previous subsection 
except that there is the term (1 — sxet c{xo{a)){y)) in tli6 integrand. We can now proceed exactly 
as in the previous subsection to evaluate the determinant (jll4p . The new term in the integrand 
only changes that Q{i, k) in (jl02p contains the term (1 — sX(t,oo)(0) ™ the integrand. Therefore, 
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we obtain, similarly to (|112p . 

j+i,n(afc, Jj(xo(a); s) 



det 



£n-j,n{Jn{xo{a));s) 



j,k=l 



-Q gn,G(xo(a);aO-ni/2 det[AA] (detfT'] det[QT;s] + o(l)), (121) 



fc=l 



where Qt s is the m x m matrix with entries 



/oo ^ 
r^'e-2«'+-''«(i-sx(T,oo)(0)«!e 
-oo 



(122) 



Combining (fTT2]) . (fTTil) . (fT2T]) and Theorem [TH we find that (recall for the definition of 

Gk) 



Snisiir-- ,a^; jJ(xo(a));s) =^^^(1 + o(l)) = Gfc(T; qi, • • • ,afc;s)+o(l). (123) 
Hence Theorem 11.41 is proved. 



5 Proof of Theorem II. 5t secondary critical case 

We assume that the support of the equilibrium measure associated to V consists of one interval. 
Let a € \ {ad- Then G{x;a) attains its maximum in (c(a), oo) at more than one point. We 
assume that the maximum is achieved at two points, which we denote by xi(a) < X2{a). We write 
xi{a) as xi and X2{a) as X2 for notational convenience if there is no confusion. Set 

Ginax := G(xi; a) = 0(2:2; a). (124) 

We assume, as usual, that G"{xi;a) / and G"{x2;a) / 0. 

Throughout this section, we fix m G {1, 2, • • • , m}. Recall the definitions 



m-2m + l ^ / (m - m)! (-G"(xi(a)))'"-"^+V^ \ ""^'"+^ ^^25) 



X2(a)-xi(a)' \im-l)\ (-G"(x2(a)))™-i/2 

Set 



a :=a-qm , (126) 



n 



and we assume that 



ak = a-qm \ = aH , k = l,---,m, (127) 

n n n 



for fixed distinct a\> ■ ■ ■ > am- 
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5.1 Evaluation of det [r„_j(afc; n)] 

The goal here is to prove the asymptotic formula ()156p given at the end of this subsection. 

Analysis in this section is similar to that of Section 14.11 but with the change that the main 
contribution to the integral formula of Tn-j{sik',n) comes from two intervals (near xi{a) and X2{a)) 
instead of one interval as in (j98p . This is because of (jl24p . We have a small enough e > and a 
corresponding 6 > such that 



n-j 



n.G{y:ak) 



dy + l^ M,, „(2/)e'^«(^^-^)dy) (1 + 0{e-'n)- (128) 



where 



Ei:={xi-e,xi+e), E2 := {x2 - e,X2 + e). (129) 

Since the two integrals are asymptotically of same order, the evaluation of the determinant det [r„_j(afc; n)] 
is more complicated. 

Using the Andreief's formula in random matrix theory (see e.g. [26]), we have 



n 

= det 



det 



E1UE2 



j,k=i 



(130) 



j,k=i 



'E1UE2 

det[Mj,n{yk)] det[e"(^(J^'=''^^)-^(^^'^'=))]dyi • • • dy^. 

For each variable yk , the integral in y^ is over EiU E2- Using the symmetry of the integrand in y^ 
in the last line of (I130p is symmetric in y^, (I130p equals 



1 

m! 



1 

—y 

m! ^ 

£=0 



in 



(131) 



where, for £ = 0, - ■ ■ , m. 



If :-- 



[ dyi---dy^.J dy^_,+i---dy^det[M,,„(yfe)]det[e"(«(^'='^^)-^(^i;^^))]. (132) 

Je^^' JEi 



We now evaluate the leading asymptotics of for each L For t = (ti,--- ,tj), let Aj(t) 
Wi<k<t<ji^^ ~ ^k) denote the Vandermonde determinant. For each j, set 



j j 
•'K^ 7 1 J 1 



(133) 



k=l k=l 

This is the partition function of the j-dimensional GUE. We have the following lemma. 
Lemma 5.1. For each ^ = 0, 1, • • • , m, we have 



n 

k=0 



kl 



k\2i-l /, h \ 2 



n 

fc=0 



^2 
kl 



det[P^] det[Q^]Z^_^Z^(l + o(l)) (134) 
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where is defined in (jl33p . Fe o-nd are defined in Theorem \1.5l and 

Uj:={-nG{xj;a))-^/^ j = 1,2. 



(135) 



Proof. Since G{y] a^) — G{xi;a.j) = G{y; a') — G(2;i; a') + -^{y — xi) and G(xi; a) = G{x2; a), (I132p 
equals 



where 



and 



Qk{y) 



D{y) :-- 



det[M,-„(yfc)] det[g,(yfc)] \[ e^^'^y^Uyk, 



k=l 



„a^.{y-xi) 



ye El 



(A'mn)'J'"(="2-=:i) 

fG(y;a') - G(xi;a'), y G ^i, 



(136) 



(137) 



(138) 



_G(y;a')-G(x2;a'), y G ^2- 

Note that first i of are m Ei and the rest yk are in £'2. Using the Taylor's expansion, we 
have for /c = 1, • • • , m — ^, 



^ (^-1)! 



and for k = m — i + 1, ■ ■ ■ ,m, 



M,- „(yfc) = J2 f - ^2)'-' + 0(|yfc - :r2|^). 



(140) 



- (i-1)! 

Let be the matrix defined similar to = "1-^)1(^2(0),^) jj-^ ^]^g statement of the theorem 

but with Aij replaced by Mj^n in the entries. By Baik and Wang Proposition 6.1] we have that 
Mj^^{x) = A4j'\x){l + 0{7i~^) and they are bounded uniformly in n for any x in a compact subset of 
(e, 00). (This was also discussed in the previous section in (fTOOD .) Since (-l)™('"-i)/Met[P£] > 
and 1/ detp^] are bounded uniformly in n (by Proposition 17. ijFb)] see (jH])), det[P^] = det[P^](l + 
0(1)) and the entries of P^^ is 0(1) . Thus (jl40p implies that 

:det[P£V^ + E(^)] =det[P£] •det[V£ + P7^e(^)] (1 + 0(1)) (141) 



m 

k=l 



where 



(yi - 2:1) 



(m-^-1)! 






{Vm-e - xi) 



(ym-^-^i)'"-' 

(m-^-1)! 










1 

{ym-e+i - X2) 

^ (£-iy. 








1 

(ym - X2) 

(£-1)1 



(142) 
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and E^^) is a matrix with entries satisfying, for each j = 1, • • • , m, 



^ \0{\yk - xil—^-i), k = !,■■■ ,m-e, 
\o{\yk-X2\'-^), k = m- ^ + !,■■■ 



(143) 



m. 



Similarly, we have the Taylor expansions 



QjiVk) = 2^ — T, + 0{\yk - xi 

i=l 



(144) 



for A; = 1, • • • , m — and 

Qj{yk) = 



{^^( E^-^ + 0{\yk-X2\' 

^ i=i 



for k = m — £ + 1, ■ ■ ■ ,m. From the arguments above we find that 

1 



det[Q,(yfc)] 



m 

] \yK:nj,k=i 



det[Q^] -detlV^ + Q.-iE^^)], 



(145) 



(146) 



where is same as in (jl42p . is defined in Theorem 11.51 and the error matrix E*^^-* satisfies the 
same estimate (fTi3]) of E(i). Note that (_i)m(m-i)/2 det[Q£] > for ai > • • • > 

We now evaluate the integral in Ii using the Laplace's method with the change of variables 



yk = xi + 
ym-e+k = X2 + 



Sk 



V^-7iG(xi;a)' 
tk 



k = l. 



/c = 1, 



, m 



(147) 



y/-nG(x2;a) 

Note that under this change of variables, with the notations Uj defined in ()135p . equals the 
diagonal matrix diag(l, wi, • • • , 1,^2, • • ■ 



, ^TTxyr) times the matrix 



A, 



?(s,t) : = 



1 

si 

,m-£-l 
'1 






1 

Sm-e 












1 

h 

,e-i 








1 

ti 



(148) 



Also for each j = 1, • • • , m, (|143p implies that 

,(1) _ /©(ra-^"""^)/^ • kiT"^), k = l, 



E 



0(n-^/2.|t,f), 



A; = m 



,m-£, 

'+ I,-- - ,m. 



(149) 
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Hence 



det|v,+p,-'E<')i= n tn!i-iet 



A;! J-J- kl 

k=0 k=0 



maxk\sk\"^ ^ + maxfc|tfc|^ 



n 



. (150) 



The determinant of + -"^E^^^ has the same asymptotics. Also note that for k = I, - ■ ■ ,m — £, 
the term e'^^^^''^ dyk in the integral (jl36p becomes, under the change of variables (jl47p . 

The term for k = m — i + 1, ■ ■ ■ ,mis also similar. Therefore, we find by applying the Laplace's 
method to (fT36D and using (fTiT]) . (fTiHD . (fTHID that 



fc=0 



TK n n t detlPddetlQ,] 



(/i:mn)'''"(2:2-a;i 

/ |A^_,(.)|2 TT e--2'Us,] \ [ \Ae{t)\''e-'2'Utk] (1 + o(l)) 



(152) 



m—i—l , fc \ 2^-1 / fe\2 



{Kmn) 



k=0 



k=0 



n I n t ^d<^t[p,id.t[q,|.z„.,z,(i+o(i)). 



□ 



We now evaluate the asymptotics of the sum in ()13ip using the above lemma. Since ^/noji 
{^/nuJi)~^, det[Q^] detp^] and its reciprocal are all 0(1), we find from Lemma l5. II that 



' f2-i("^^-2mi+2j2)_5„(a;2-a::i)j ' 
^-|(m2-2m/c+2fc2)-g„(x2-xi)fe 



0(n 



(fc-m+i)2-(j-m+i)= 



) 



(153) 



for all j,k £ {0, - ■ ■ , m}, by using the definition ([5U|) of g^m- Hence Im-i and Im are of same order 
and the other are of smaller orders (at least by factor n^). This implies that ()13ip becomes 



m! 



m 

m — 1 



m 



m 



(1 + 0(1)). 



Thus, from (|128p and ()130p . we have 

det[r„„,(a,;n)];",^,= fne"«(--)U 



m 

m — 1 



Im-l + 



m 



(154) 



(l + o(l)). (155) 



Therefore, using the asymptotics (I134p of I^, the value of Zj in ()133p . and the definition of K„ 
in ([Ml), we obtain 



det[r„_,(afc;n)]-,=i = e"«(-i^-'=)- 



i/2 



( ™ ) 



m! 



•-m— 1 



1 + 



det[P^] det[Q^] 
det[Pm„i] det[Qm_i] 



(156) 
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5.2 Evaluation of det [Tn-j{a.k; n)£n-j+i,n{aik; Jl{xi)] s)]^^^^^, z = 1, 2 

The analysis in this subsection is similar to Section [4.21 but as in Section [5.11 the main contribution 
to involved integrals comes from neighborhoods of two points xi and X2- 
We consider the interval J^{x2) first. From (jll4p in Section [4.21 



det [Tn-j{ak;n)£n-j+i,ni^k; (3:2); s)] 



det 



Sn—j+l,n 



:i + o(l)). (157) 



j,k=l 



Now p2U|) is changed to, as it happened to (|128p . 

£n-j[JAix2);s) Ue, 

+ / M,,n{y)e-''^y^^''\l-sxErA.2)iy))dy 
JE2 

for some e > and 5 > 0, where Ei are in (jl29p and ET,e{x2) is the interval 



(1 + 0(6-^'^)) (158) 



ET,e{x2) := ix2 + T/V-G"(x2)n, X2 + e) 



(159) 



Now the analysis of Section 15.11 goes through with the change that the measure dy is changed to 
(1 - sxETA^2)iy))(^y y^E2. Thus we find (cf. (HMD and m^ ) 



det 



r "1 

M,,„(2/)e"«(^^'^'^)(iy+ / M,v„(y)e"^(^^=*'=)(l - 5Xi?,^(x.)(y))d2/ 

(n="°'"'^"')^E(T)l'(r;») (160) 



where 



with 



„ m 

Ii{T; s) := / det[Mj,n{yk)] det[Qj{yk)] TT e"^(J^'')d/i(y, 



(161) 



diJ-iyk) 



jdyk, k = l,--- ,m-£, 

[{'^ - sXETA^2)(yk))dyk, k = m-i + l,--- ,m. 

The analysis that yields Lemma l5 . 1 1 applies with trivial modifications and we obtain (cf. (|134p ) 



(162) 



where 



07 n TT n •det[P,]det[Q,]Z^„,.Z,(r;.)(l + o(l)) 



fe=0 



/t=0 



,{T-s):= \ |A,(t)|2r[e-^*^'(l-sx(T,oo)(ii))c?ij- 
,=1 



(163) 
(164) 
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Therefore, we obtain, as in (|156p . 



det 



j,k=l 



gnG(a;i;afc)-n£/2 



( ) 
X —Im-i{T S) 

m! 



1 + 



(T; s) det [Pm] det [Q^] 
(T; s) det[P^„i] det[Q^„i] 



(l + o(l)). (165) 



For the interval jj(xi), (1158^ is changed to 



(l + 0(e-^")). (166) 



Corresponding to (jl3ip and ()160p . we have 



det 



El 



M,>(?/)e"«(^^'^^)(l - sxi^,„(.,)(y))^y + / M,,„(y)e"«to^'^'=)(l - s)(iy 



£^2 



fn="°'""'')^E(7)i'(r;») (167) 



where I^(T;s) are defined analogously to \g in (jl36p and (jl6ip . and it is straightforward to obtain 



((A'mn)'''"(^2-a;i))£ 



ir \ 2 ^-1 / t \ 2 



n ? n(i) -detlPrfdetlQ,] 

fc=o ^ ■ ^ fc=0 ^ 



X Z^_,(r; s) • (1 - s)^Z,(l + o(l)). (168) 



The difference from (jl63p for l£(T;s) is that we now have Zm_£(T;s) and(l — s)^Z£ in place of 
Zim-e and Z^(T;s), respectively. Therefore, we obtain (cf. (jl65p ) 



det 



(afc; Jj(xi);s) 



X —Im-i{T; s) 



m! 



£n—j,n{Jn{-^l)'} ^) 

1 + (1 - s) 



n 



,nG(xi;as.)-n£/2 



Zm— m+1 Zm— m (T; s) det [Pm] det [Qm] 

Zm— m Zm— m+1 

(T; s) det[Pm_i] det[Qm_i] 

x(l + o(l)). (169) 



Combining (jl65p and (jl56p . we obtain 

det[Pm_i] det[Qm-i]%i^ + det[Pm] det[Qm]^#^ 

'fn(ai, • • • am; Jn (2:2); s) = jTT^ n . ,r^'" — 1 , ^ .ftj 1 a ^^r^ 1 ^+0(1) (170) 

det[Pm-iJ det[Qm-iJ + det^P^J det[QmJ 
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and from (jl69p and (jl56p we obtain 

det[P™_i] det[Q™_i]%^i^±i^(l - + det[P™] det[Q^] ^--^^'^^ 1 - s)^ 



+ 0(1), (171) 



det[P^_i] det[Q„_i] + det[P„] det[Q,„] 

where we use the convention that =1. It is easy to check that the convergences in (I170p 

and (jl7ip are all uniform for s which is close to 1. Since ^^^'^^ = Gi{T;0, ■ ■ ■ ,0;s) (see (j40p ). 
Theorem 1L5J follows from (I42D. 



6 Proof of Theorem [TTS critical case 1, continuous transition 

We assume that the critical value slc = ^^'{^) ^-iid suppose that ac ^ i7y- Let 

^ik = \v'ie) + ^, k = l,---,m, (172) 

for fixed, distinct real numbers ai, • • • , Om- Here /3 is a positive constant defined in (jl7p . The proof 
of this critical case is more involved than other cases. We first need to perform some algebraic 
manipulations of the determinant in Theorem 11.11 to make it asymptotically easy to evaluate. 

We start with a formula that is equivalent to but slightly different from Theorem 11.11 From 
Lemma 18.11 which is an intermediate step toward the proof of Theorem 11.11 



£n{E;s) det[r„_j(afc)]'" 



{'ll'n-j,V^-SXEi'i--SXEKn,nXE) ^W*) 

j,k=l 



(173) 



where (,) is the real inner product on E and ^C^^„(2;, y) = {pQ{x)pQ{y) + - ■ ■ pi-i{x)pi-i{y))e~2^^^^^~^^^y^^ 
is the usual Crhistroffel-Darboux kernel. Here pii^x) = pi^x; n) is the orthonormal polynomial with 
respect to the (varying) measure e~"'^^^^dx on M, and '4'i{x) := pi{x)e~^'^^^\ The column vector 
v(x) := {vi{x), ■ ■ ■ , Vm{x)Y is defined by 

i;fc(x) :=e"(^^^-^(^)/2)^ (174) 
and the column vector w(x) := {wi{x), • • • ,Wmix)Y is given by 

Wk{x) := ((1 - Kn,n)vk){x). (175) 

Note that the kernel Kn,n in (|173p is independent of j. This is the difference from the for- 
mula (jlip : in terms of ipi and i^£,„, the formula (jlip becomes (j278p in which the Christoffel- 
Darboux kernel appears as Kn~j+i,n, depending on the row index j. This change makes the 
following computation easier. 

We use the three-term recurrence relation of orthonormal polynomials (see e.g., [24]) repeatedly 
below. In terms of ipi{x) = p£{x)e~2^^^\ 

xipi{x) = biipi+i{x) + aiipiix) + bi-iipe-iix), i>l (176) 
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for some constants and for positive constants 



where 7^ is the leading coefficient of 



11 



6.1 Evaluation of det [r„„j(afc)j 
Using the notations above, we have (see (flOl) ) 

det [r„_j(afc)]^^^_^ = det [(^An-j, v*)]^^. 



(177) 



:i78) 



By taking a hnear combination of the last three rows and using the three-term recurrence rela- 
tion ()176p . we can replace the last row in the above matrix by the vector 



-{{x - e)V'„_m+i(x), v*(x)). 



(179) 



We then can replace the (m — l)-th row similarly by using the two rows above. By repeating this 
process up to the third row, we obtain 



n— 3 



W 6,jdet[r„_,(afc)]^";^i = det 



Now we can change the last row of this new matrix to 



(V'„_i,v*) 

(V'„_2,V*) 

((x - e)V'„„2(2;), V*) 

{{x - e)VJn-m+l(2;), V*) 



;i8o) 



1 



-((x -e)Vn-m+2(a;),v*) 



(181) 

On-m+1 

without changing the determinant, by using a linear combination of the last three rows and the 
three-term recurrence relation again. We repeat this process up to the fifth row and obtain 

(V'n-l, V*) 
('i/'„_2,V*) 
{{X - e)V'n-2(a;), V*) 

{{x - e)ilJn-z{x)y) . (182) 
{{x - e)2V;„_3(x), V*) 



n— 4 X / n— 3 \ 

n ^^)( n ^'£)det[r„_,(afc)]^";^^ = det 



l=n-m+l 

We repeat the process and obtain, for even m, 

[m/2]-l 



{{x - efi)n-m+i{x),^^)_ 



\ m 

{hn-2-ihn-m-i+if j det [r„_j (afc)] ^^^^ = det 
1=1 ' 



Ri 



Ri 



m/2]. 



(183) 
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where each i?^ is a 2 x m matrix defined by 



Rp 



{{x 
{{x- 



3)^-Vn-£-l(a;), V*) 



(184) 



The determinant in (|183p is unchanged if we add the second row of Rg by a constant multiple of 
the first row. Hence we can change the matrices Ri in (I183|) to 



Rf 



{{x 

((x-e)^-i(V„- 



i(^) 



i+l,n 



(185) 



where Bj^n{^) is the value of Bj^n{z) at z = e, and the function Bj^n{z) is a function defined in [HJ 
Proposition 6.1(b)] which appears in the asymptotic of orthonormal polynomial near the edge e of 
the support of the equilibrium measure. From the asymptotics of Bj^niz) [51 Formulas (323) and 
(313)], it was shown that Bj^niz) and its reciprocal are uniformly bounded in a neighborhood of 
z = e. 

When m is odd, we need to add an extra row {(x — e)['"/^l?/;„_[in/2]-i(^)7 v*) to the matrix to 
the right-hand side of (jl83p and the extra term ^|^'[^/2]-i '^^eds to be multiplied on the left-hand 
side. In the remaining part of this section, we consider only even m since the odd m case can be 
solved by the same method. 

We now evaluate the asymptotics of Ri+i for each i = 0,1, ■ ■ ■ . First consider the top row of 
Ri-\-i. We consider a slightly more general quantity 



n-j 



(186) 
/(afc) = 



((x-e)Vn-i(a:),e"(^^^-^(^)/2)^ 

for a later use. Observe that ipn-e is changed to ipn-j- Note from (|1U|) with a = a^, F 
('0n-i(2;),e'"(^'=^-^(^)/2)^_ Xi^g asymptotics of this inner product at the critical case was obtained 
in [HI Section 5.1] and the asymptotics of (jl86p is very similar. Namely setting 

<Pn-j{x) := '0„_j(j;)e"t^W, 

we see that (jl86p equals 



:i87) 



(C^„_,-)(^)(^-e)V"^-^(iz+ / (^„_,(z)(z-e)V=^^-J'dz 



(188) 



where {Cipn-j){z) is the Cauchy transform of ipn-j{x) and S+ and S_ are certain contours from e 
to oo lying in C+ and C_, respectively (see [51 Figure 9]). When £ = 0, it was shown in [Sj Section 
5.1] that, under the criticality assumption the main contribution to the above integrals comes from 
a neighborhood of the point z = e and an appropriate change of variable is ^ = (2; — e)/3n^/^. The 
presence of the term [z — e)^ above does not change the analysis except for an inclusion of an extra 
term 



•/3n2/3. 



in [U Formula (222)] and we obtain 



((x 



Qn(afc) 



/3V^(/5n2/3)f 



-Bj,n(e) 



Ai(0(e"^« + 6'^"'=^ + e"''°'=^)fi^ + 0(1) ) . (189) 
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where (see [HI Formula (206)]) 

(The result of [H] involves i3j^„(e) in place of i?j^„(e). But as Bj^n{z) = i3j^„(z)(l + 0(n~^)) from 
[SI Formula (323)] and is uniformly bounded, the above statement follows.) Now observe 

that (see ^ Formula (223)]) 

/ Ai(0(e"^« + e"^'« + e"^)de = e"'/^ (191) 
Jo 

By taking the derivatives of this identity with respect to a, we find that 

J^^ Ai(0(u;^e"'^« + + e"«)de = (192) 

Hence we obtain 

(,.-e)'*._,W..«<-->'M/^)) = ^J=^«„(e,(A)V;/»,^ («3) 

Now we consider the second row of -R^+i- Again we consider a slightly more general quantity 

((x - eY{^|;^.,.,{x) - r^t^ifl Vn,„,(x)), e"(-'=--^W/2)). (194) 

This can be written as the sum of the integrals (jl88p with the terms {Cipn^j){z) and ipn-j{z) 
replaced by Lpn-j-i{z) - ^^^j^^tpn-j{z) and ipn-j-i{z) - ^'^^j^^f fn-j{z), respectively. Then 
again the main contribution to the integrals come near z = e. The precise behaviors of the 
integrands near z are well known (see [SJ Formula (322)]). First, 

^n-,-i{z) - \^''f% n-j{z) = (71^/6 Ai($(z))ci(z) +n-V6Ai'($(z))c2(^)) e'^^^^) (195) 

for z near e. Secondly, 

(C^n-J^lKz) - ^j^^{C^n-,){z) = 

ef (n^/^ Ai(a;2$(z))ci(z) + n-^/^cu^ Ai'(L^2^(z))c2(z)) e't^W (196) 
for z near e with z G C+. Finally, 



-Bj+i,n(e) 

f fn^/V Ai(w<5(z))ci(z) + n-i/6Ai'(w$(z))c2(z)) e-t^(-') (197) 



{C^n-j-l){z) - =^'^' \ ' {C^n-,){z) 
-Dj,n(e) 



e 
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for z near e with z G C_. Here ^{z) is a function that satisfies = fir?l'^{z — e)(l + 0{\z — e|)) 
as 2; — 7- e and is defined by Baik and Wang [8l Formula (309)]). The functions 01(2;) and 02(2;) are 
given by 

ci(z) := i?,+i,„(z) - fe^i?,.„(z), C2(z) := - %^^.,n(^). (198) 

As S^. ^(z) is analytic at z — e and its reciprocal is uniformly away from zero in a neighborhood of 
e, we have 

ci{z) = 0{z — e) for 2; near e. (199) 

Also Bj^n{z)Dj+i^n{z) — B j j^i ^n{z) D j ^n{z) is showu to be independent of z (see (8} Formula (329)]) 
and equal to ^ where 7^ is the leading coefficient of Pi{z). Hence 

^j,n\^} In— J — I 

We note that from the explicit asymptotics [8l Formula (303), (304)] of 7„_j, and its reciprocal 
are bounded uniformly in n. 

From this we can find the asymptotics of (jl94p in a similar form as (jl89|) . The resulting formula 
contains two integrals, one involving Ai and the other Ai', since each of (jl95p . (jl96p . and (jl97p 
contains such two terms. Now notice that due to p99p and the change of variables ^ = {z — g)(5ti?/^ , 
the integral involving Ai is smaller than the integral involving Ai' by the factor 0{n~^/^). Thus we 
find that 

((x - e)^(V^._,_i(x) - %i^Vn-,(x)),e"(-^-^(-)/2)) 



Qn{a.k)Kj 

,1 



poo \ 

J e^Ai'(e)(e"^«+wVe'^"'=« + wa;2V'"'=«)dC + o(l)] • (201) 



/3n5/6(/3n2/3)'?5^.„(e) 
The integral above can be simplified by the identity 

^"e'Ai'(0(^'w'e""« +W6.2^e"'^'« + e"«)de = (^) V«e"'/=^). (202) 
This identity is obtained by taking derivatives with respect to a of the identity 



Ai'(0(c^^e""'« + cje""^ « + e"^)^^ = -ae" /^ (203) 
which follows from (I19ip after integrating by parts. Hence we obtain 



{{x - e)^(V'„-,-i(x) - %l:^Vn-,(x)),e"(-'=-^(-)/2)) 



/3n5/6(/3n2/3)^Sj-„(e) V^^afc 



\ake''l/^) + oil). (204) 
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Inserting (fT93]) and (pOij) (with £ £ - I and j = £) into (fT85]) . we obtain that (fT83|) equals, 



when m is even, 



[m/2] 



n 



L (/3n2/3)2^ 



fc=l 



det 



V 



e«i/3 



aie 



"?/3 
="!/3 



J3 



^L/3 
^?./3 



_d_ ( 

dam 



+ o{l) 



(205) 



Note that the {j, k) entry of the determinant on the right-hand side of (|205p is of the form 
Pj{ak)e°'k/3 for some polynomial Pj{x) of degree j — 1 with leading coefficient 1, (i.e., Pj{x) = 



+ •••), which are defined by the conditions 



2i, 

2i + 1. 



(206) 



Therefore, by elementary row operations we find that the determinant is same as the determinant 
of the matrix {ajT^e^k/^'j™-^^-^. The determinant of this matrix is ni<j<fc<m('^fc ~ "^i) YlT=i e"^^^ 
and this is nonzero. Therefore, when m is even. 



[m/2]-l 



det (r.„_j(afc)) 



j,k=i 



[m/2] 

n 



_JL (/3n2/3) 

We have a similar result when m is odd. 



2i 



n Qni^k)e- 



-1/3 



k=l 



n (afc-a,)(l + o(l)). (207) 



6.2 Evaluation of det 



V* - SXit{1 - SXirKn^nXn 



We now evaluate the numerator of (|173p when E = I^. Note that V'n-j is the only term that 
depends on j. Hence by using the same row operations as in Section 16.11 that lead to (jlSSp and 
(jl85p . we find that, when m is even. 



[m/2]-l 

n i" 



det 



{iJn-j,V - SXit{1 - SXlTKn,nXlT) W ) 



det 



Si 



Si 



m/2] 



where S'f is a 2 x m matrix given by 
Se 



{{x-ef ^'tpri-e{x),V* - SXit{1 - SXlTKn,nXlT) 
{{X - e)^-l(V'n-^-l(^) - ^^^^Pn-iix)),v' - SXlTil - SX/Ti^n,nX/T)-V*)_ 



(208) 
(209) 



36 



We can write this as 



St — Re 



(210) 



where U^j = (U£j(ai), • • • ,U£j(ain)) and V^j = (V^j(ai), • • • , V£j(am)) with 
U£j(afc) := {{x - eY^n-j{x), sxMl - sxiTKn,nXiT)~^Wk) 



j(afc) := {{x - eY{'4)n-j-i{x) 



'^n-j{x)),SXlT{l - SXlTKn,nXlT) ^Wk). 



(211) 



The asymptotics of ipn{x;a.i:) = Yi(al) "^^^^ obtained [HJ Lemma 5.2]. From this the asymptotics 
of Uij /Tni&k) when i = and s = 1 were obtained in [HJ Section 5.1.3]. It is straightforward to 
extend this to other i and s as in the previous subsection. We can fohow the arguments in [HI 
Sections 5.1.2 and 5.1.3] almost verbatim and find 



^r^^^i = {{x - eYi^n-j{x),sxET,A'^ - XitKu^uXit) ^^n-i(x; afc))(l + o(l)) 

= j/3)^ ■SX[T,oo)(l - SX[T,oo)^AiryX[T,oo))"^C'-afc(0)(l + 0(1)), 

where Ex^e = -^n \ + ^) with a smah enough constant e and 

dz 



(212) 



-a + 



(213) 



is defined in (j56p . Using the asymptotics [HI Formula (197)] of r„(afc) (It was given in terms of 
i3j^„(e) but we can change it to i?j^„(e). See text in parenthesis below equation (|19U|) .). this implies 
that 

U.,,(a,) = ^j^^^j^^yi^^ ^ (214) 
Similarly, as in the argument for the asymptotics (|20ip . we find that 

,n 



/3n5/6(/3n2/3)^5^.„(e, 
Recall the polynomials Pj{oi) defined in ()206p . We claim that 



:"^/3(^^Ai'(0,s(l - 5X[r,oo)^AiryX[T,oo))^'C_,,)(l +o(l)). 

(215) 



d 



eM{i) = P2^{--)km, 



d 



-rAi'(e) = P2m(-37)Ai(6- 



di' 



(216) 



To see this, note that successive integrations by parts of the integral representation of the Airy 
function Ai(,^) ^ 



2tt 



T^T /c^e-W3 e ^''+3*''ds imply that, for any i. 



' l_ _ 



d\ 1,3 
ds 



ds 



27rV=T 



^e-«^P2.(s)e^^'ds. (217) 
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Hence 



em) 



1 



27rV-l 
1 



i/3 



ooe "^^/S 



27rV-l 

which proves the first identity of (j216p . Similarly, for any i, 



(218) 



1 pcae^^l'^ , 1 /■ooe" 

27rV— 1 Jooe-'^'/S 27rv— 1 Jooe—^^l'^ 



(is 



1 f'ooe""''^ J 



(219) 



which proves the second identity. 

We insert ()216p into ()214p and (j215p . This gives the asymptotics of the second matrix in the 
definition of Se. For R^, we use the asymptotics (jl93p and (j204p and insert (|206p . Then we obtain, 
when m is even, 



[m/2] 



i (/3n2/3) 



/3 



fc=l 



X det 



-Pj-l(afc) - ^H^)' SX[T,oo)(l - SX[T,oo)-f'^AiryX[T,oo)) ^C'-aJ + o(l) 



Simple row operations then imply that the last determinant, without o(l) term, equals 

d 



det 



((--^y ^ Ai(0,SX[T,oo)(l - •SX[T,oo)^AiryX[T,oo)) ^C*- 



Ofc/ 



i,fe=l 



(220) 



(221) 



6.3 Proof of Theorem 11.61 

From (fT73D . (|2071) . and (|22T]) . we find that 

£n (^1 ) ■ ■ ■ 5 ) -^n j ■5) 



det[L»„,(s) 



Fo{x) 



+ 0(1) 



(222) 



where 



{-OkY ^ - ii-^y ^ Ai(^),SX[T,oo)(l - •5X[T,oo)^AiryX[T,oo)) ^C'-aJ 



(223) 



When s = 1, Dm(s) is precisely the matrix M defined in [21 Formula (3.36)] with Wk = —otk 
(see [21 Formula (3.9)] for the definition of and [21 Formulas (3.4) and (1.10)] for the definition 
of Ti). A different formula of det(M) was then obtained [21 Formula (3.46)] in terms of function 
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f{x;w). Comparing with the case of /c = 1 of [21 Formula (1.16)], this function f{x,w) = ^p^^(^'^^ 
and this imphes that 



det[Dm{l)] = det 



\ , d •_iFi(r;-afc;l) 



(224) 



When s ^ 1, the only difference of Dm{s) from M is that the function Eyj (defined in [2j 
Formula (3.9)]) is changed to E^{u) := ^"') (^)' '^^^ proof of Baik |2l Formula (3.46)] goes 

through without any changes and we obtain 



det[L»„(s)] = det 
From the definition of ()58p . we obtain ()6ip . 



(225) 



7 Non-vanishing property of some determinants 

As discussed in Section 11.41 in each of the Sections [2][5] we need the fact that the determinant 
of a certain matrix is nonzero and is uniformly bounded away from zero. Specifically, we need 
this property for the following four matrices [■Mj,n{c{sik))]J^k=i dSS) of Section [2j *p in (j9ip of 
Section El V = [Mf~'^\xo{a))]1^i^^ in ([nO]) of Section H and Pi = fp('^-in-i).(^i) in (j46]) (see also 
the discussion after (I140p in Section [5]). 

In this section, we prove that the determinants of these matrices are uniformly away from zero 
in a unifying way. This was obtained by considering a more general matrix which includes the 
above matrices as special cases. We can show the nonvanishing property from a direct algebraic 
manipulation of the determinant when the support of the equilibrium measure consists of a single 
interval (i.e. = 0) since in this case the entries of the matrix do not depend on n and are 
expressed in terms of a simple rational function. However, when the support consists of multiple 
intervals (i.e. > 0), the entries involve a Riemann theta function and it is not easy to check 
directly that the determinant is nonzero. 

Instead we proceed as follows. The entries of the desired matrix are expressed in terms of 
the solution of the so-called "global parametrix" Riemann-Hilbert problem (RHP) for orthogonal 
polynomials. Using this, we show that the desired determinant itself can be expressed as a product 
of the solutions of different RHPs, which are a Darboux-type transformation of the above global 
parametrix RHP. We exploit a relationship between the original RHP and its transformation in 
order to prove the nonvanishing property. 

We now introduce the general matrix which we analyze. Let A^j^„(z) and Aij^niz) be defined in 
[HI Formula (311) and (312)]. They are expressed in terms of the solution to the global parametrix 
RHP, see (I229P and (I232p for the explicit formula. We note that they are analytic, in particular, 
for z E (e,oo). We also note that when A^ = (see (j45]) ) 
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for z in C \ (—00, e]. 

Let {ci, • • • , Cp} be a set distinct real numbers in (e, 00) and let {di, ■ ■ ■ , dg} be another set of 
distinct real numbers m z £ (e, 00) for some nonnegative integers p and q. For each n, we define 
the {p + q) X {p + q) matrix 



jYjCi,--- ,Cp 



Ml,nidl] 



Ml,n{dq 



M 



p+q,n {di 



M 



p+q,n 



A^l,n(ci) 
Mp+q^n{ci) 



M 



'P+q,n 



(Cp). 



(227) 



Special cases of this matrix appeared in the proofs of Theorem ll.2l in Section [2] and of Theorem 1 1.31 
in Section [3l 

We also consider a slight extension of the above matrix whose special cases appeared in the 
proofs of Theorem [13] in Section [5] and of Theorem ll.Sl in Section [5l Let mi, ■ ■ ■ , nip and ni, 



be positive integers, and set s := mi + • • • + and t = ni + • • • + Ug. For each n, define the 



(ci,mi),--- ,{cp,mp) 



(s + t)x(s + t) matrix qj ™: 



(iii,ni),--- ,{dq,ng) 



by the entries, for each j = 1, • • • , s + t, 



$yv{ci,mi),' 



,{cp,mp)\ 



M 
M 



(fc-1) 



{dl 

(k-m-l) 



{d2 



for k = 1, - ■ ■ ,ni, 
for A; = ni + 1, • • • 



,ni +n2, 



M 
M 



(fc-t+n,-l) 



(fc-t- 



{d. 



1) 



(^1) 



for k 
for k 



(228) 



t + 1,' 



,t + mi, 



^^k-s-t+mp-l) , 



for /c = s + t — mn + 1 , 



,s + t. 



yCi,--- ,Cp ^ ^ „f cYj(ci,mi),--- ,(cp,mp) 

(di,ni),--- 

result of this section is the following proposition. 



Note that is a special case of Vi^^i^'n^y.. '^d^'n)' when all mj 



1 and Tin 



1. The main 



Proposition 7.1. Let p,q be nonnegative integers, ci,--- ,Cp be a set of distinct real numbers in 
(e, 00) and di, - ■ ■ ,dg be another set of distinct real numbers in (e, 00). 



(a) iei be defined in (1227^ . Then for all positive integer n, det[^^^'...'^^] 7^ 0. Also both 

det[^^^'...'^*' ] and its reciprocal are bounded uniformly in n. Moreover, if ci < ••• < Cp and 
di<-- - <dg, then {-l)P'}+P^P-^y^{-i)'> deti^Y^J] > 0- 



(b) Let mi,-- - ,mp and ni,--- ,nq be positive integers and let (rf^'".^)^ defined by 

([228]) . Then for all positive integer n, det[<:p[^'^'^^')^;';; '('^^^^^•^^^] / 0. Also 6oi/j det[*pj^'^'^'^'^^;;'; '(^^'^^'''^^^^] 



and its reciprocal are bounded uniformly in n. Moreover, if ci < 



then (_i)st+s(s-i)/2(_^)t det[^f^\'2t- 



(ci,mi),--- ,(cp,mp)i 



< Cp and dl < 



< dq. 



> 0, where s 



, ,yu,q,i{,q 



mi + 



+ mp and t 



Ui + 



+ rig. 



Even though Proposition 17.11 (a) is a special case of Proposition I7.1l|(b)[ we state these results 
separately for the ease of citation. 
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The idea of this proof is motivated by the paper [5] which evaluates the orthogonal polynomials 
and their Cauchy transforms with respect to a weight which is a multiplication of a given weight by 
a rational function. This procedure bears resemblance to the Darboux transformation in spectral 
theory. 

Remark 7.1. In this section, we use the abbreviation '/„ x 0(1) uniformly in n' to mean that for 
a sequence fn, both and j- are bounded uniformly in n. 

7.1 Proof of Proposition 17.11 



We first prove part 



Let J := U';^,{bj , Oj+i), 6o < ai < • • • < ajv+i, be the support of the equilibrium measure given 
in ([I5D. From [H Formulas (311) and (312)], 

Mk,niz)=Ck,n-[Mk]uiz), Mk,niz) = Ck,n ■ [Mk]l2iz) (229) 

for any 2 G C \ {bQ,aN+i), where the constant Ck,n '■= Tn-fcc"^''^ and the 2x2 matrix Mfc(z) := 
^k°n (^) satisfy the following properties. 

First, the positive number ■jn-k is defined in [8l Formula (304)] in terms of the Riemann theta 
function 9. This particular theta function satisfies the property that 6{V) 7^ for all real vector 
V from (the proof of) \n\ Formula (3.38)]. Hence due to the periodicity of the Riemann theta 
function, |0(1^)| is uniformly bounded below and above for real vectors V. Since all the arguments 
of the Riemann theta functions in the definition of jn-k are real, we find that 



Ck,n ^ 0(1) 



(230) 



uniformly in n. 

The matrix NLk{z) := M^\z) is explicitly defined in ^ Formulas (300) and (301)]) in terms 
of a Riemann theta function. However, we do not use this formula; instead we use the following 
Riemann-Hilbert characterization given in [8l Formulas (295)-(297)]. Let v(x) for x S S := 
(6o,a7V+i) \ {h, ■ ■ ■ ,bN,ai, ■ 



v(x) := 



, Oat} be the jump matrix defined by 





1 
-1 



for X E {aj,bj), j = !,■■■ ,N, 
for X £ J, 



(231) 



where fij, j = 1, - ■ ■ ,N, are real constants defined in [HI Formula (1.21)] (see also [U Table 1]). 

.r(oo) 



Then for k G Z, Mk{z) := Mjff^ (z) solves the following RHP: 



Mfc(z) is analytic in C \ S and is continuous up to the boundary, 
[Mk] + {x) = [Mfc]„(2;)v(x) for x € S, 



Mfc(z) = [I2X2 + 0{z~')] 



z-^ 







(232) 



as z 



00. 
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Let us denote 



so that (|229p become 



Mkiz) 



Note that even though we do not exphcitly indicate it, £!]^\z) and 'ri^\z) depend on n. 



(233) 



(234) 



From the hypothesis of Proposition I7.1|(a)| ci, • • • ,Cp are distinct real numbers and di, • • • ,dq 
is another set of distinct real numbers, all in (e,oo). For integers < s < p and < i < g, let 
(JsAkTd^ ...''^dSz) 2x2 matrix whose entries are defined by, for each i = 1,2, 



1 - 2 



X det 



eil+i(ci) 



and 



(i) 



(235) 



X det 



/ eil(ci) 



di — z 



;fcl,+i(cs) VkL+i(di, 



.(0 



(0 



(236) 



Now we proceed to prove Proposition 17. l|(a)] as follows. We consider only the case when g > 0. 
The proof is completely analogous when (7 = 0. When g > 0, from (j234p and (j236p . we have 



To show that det [^3^'^ ' y. '^^ ] ^ 0(1), we only need to prove that {{m,p^x)X'. '.-4 ^^^-i^dq) ^ '^^^^ 
uniformly in n due to (|230p . We prove this by showing that for all s G {0, 1, • • • ,p} and t S 

{o,i,-- - 

[(M.)^;';:.f,:],,(x) ^ o(i) (238) 

uniformly in n for each i,j = 1,2, for each integer k, and for each real number x S (e,cxD), using 
an induction in s and t. 
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When s = t = 0, Mfc(z) has an exphcit formula in terms of the Riemann theta function 9 [HI 
Formulas (300) and (301)]. Note that for x G (e,oo), u±{x) is a real vector by the construction of 
u defined in [17^ Formula (1-29)] and [161 Formula (1.29)]. Since all the arguments of the Riemann 
theta functions are real vectors, we find, as in the discussion above (j230p . that [M.k]ij{x) x 0(1) 
for each i,j = 1, 2, for each integer k, and for each real number x G (e, oo) 

To complete the induction step, it is enough to show that if (j238p holds for s = i and t = i' , 
then it holds for s = £ + l,t = i' , and also for s = i,t = £' + 1. Recall that the (j,£)-minor of a 
square matrix is the determinant of the matrix formed by removing the j-th. row and i-th. column 
from the original matrix. For i = 1,2, we denote the {l,s + t + l)-minor of the matrix on the 
right-hand side of (|235p by Aji. We also denote the (s + t-|-l,s + t-|- l)-minor of the matrix on 
the right-hand side of ()236p by Aj2. It is easy to see from the definition that and when t > 0, 

t-i 

Aa =mk+ir,\\::.2_Mdt) Hidj - dt), (239) 

A,2 =[(Mfc)|';:.'2_Ji2(dt) Hid, - dt), (240) 

i=i 

and when t = 0, 



= [(Mfc)^^'-''=-^]a(c.)n(ci-c.), (241) 

s-l 

Ai2 =[(Mfc_i)^i'-'^-i]a(c.)n(ci -Cs). (242) 

Now let (Mfc)^'';;;^';(z) be the solution to the RHP (p32|) where the jump matrix is changed to 
•v{x) which is given by v(x) = v(x) for x G S \ J, and 

■{Cs-X) ' 

for X e J. (243) 



vix 



Q (ei-x)---(c3-x) 
-x)---{dt—x) 
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{di-x)---{dt-x) Q 
{ci-x)---{cs-x) 



The existence of the solution to this RHP is given in the next subsection. The uniqueness follows 
from the fact that det v = 1 . 

Lemma 7.1. (a) For s > 0, i/ ((Mfc)'=i'-''=''-i)ii(cs) / and ((Mfc_i)<^i'-''=''-i)2i(cs) / 0, then 

(Mfc)^i'-'^=(z)=diag(An,A22)(Mfc)^i'-'^=(2), (244) 
where An and A22 are given in ()24ip and ()242p . 
(b) For t > 0, if {iMk+iTl':::%Ji2{dt) + O and ((Mfc)^;';:.2_,)22(dt) + 0, then 

(M.)?;;:.2(^) = (-1)* diag(An, A22)(M,)^-;:.2(.), (245) 
where An and A22 are given in (|239p and (|240p . 



43 



Proof. This is straightforward to check. □ 

From the RHP, we can show the nonvanishing property of the entries of (Mfc)|^^' ' 
Lemma 7.2. For any integer k, real number x G (e, oo), s G {0, 1, • • • ,p} and t G {0, 1, • • • , q}, 

- 0(1), id = 1, 2, (246) 

uniformly inn and [(Mfe):;;';:.f/Jn(x), [{mkf^Y---^^^^^)' [-i{^k)Z---X]^^i^) andi[{mu)2:[:::X\2i{x) 
are all positive. 

Proof. The proof will be given in Section 17.21 □ 

Thus Lemmas 17.11 and 17.21 imply that if (1238^ holds for s = (. and t = i' , and so does for 
s = £ + l,t = i' , and also for s = £,t = £' + 1. The induction step of the proof is complete and we 
obtain det[%Y;:X]-0{l). 

If we take inductive steps, in particular, as (s, t) = (0, 0), (1, 0), • • • , {p, 0), (p, 1), • • • , {p,q — 1), 
then we find an explicit formula of [(Mp+i)^^'...'^*' ^]i2{dq), which implies from ()237p that 

jCl ,Cp 1 
dqi 



(-i)^Mn^i?c^.Mdet[<p^-:.;' 



= flm,^i)Z:-2-Mdt) n[(Ms)^^'-'^^-]ii(c.). (247) 



t=l s=l 



From this formula and the signs of [(Mfc)|j^''''.'rf'Jij(a^) i n Lemma l7.2| we find that if Cj and dj are 
both in ascending orders, then (— 1)*"^+p(p~^)/^(— i)'^ det[^^^'...'^*' ] > 0. This complete a proof of 
Proposition I7.1|(a)[ 

We now consider Proposition I7.]|(b)| Note that the identity (|247p is analytic in Cj's and dj's. 
Hence if we take the limit so that some of cj are identical and some of dj are identical, then by 
I'Hopital's rule, we obtain Proposition 17. l|(b)| 

7.2 Evaluation of (M^ ) ... ^ 

In this section we prove Lemma 17.21 by finding an explicit formula of (Mfc)|^^'...'^° (z), which is 
obtained by solving an RHP in terms of a Riemann theta function 

We can consider the following slightly more general RHP. Let S := (6o, aAr+i)\{&i, • • • , &7V, oi, • • • , a^} 
and J = [jjLo{bj,aj^i) as in (|232p . Let /(x) be a positive real analytic function on J. Let the 
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2x2 matrix N(z) be the solution to the following RHP: 



N(^) is analytic in C \ S and is continuous up to the boundary, 





^—iriQj 







N+(2;) =N_(x) 
N+(x) =N_(x) 
N(z) = [/2X2 + Oiz-^)] 



fix) 
l/f{x) 



z^^' 







for X S S \ J, 
for X G J, 



(248) 



as z 



oo. 



The matrix (M^)^^' ' is the special case of N(z) when /(a;) is rational. 

We now solve the the above RHP for N(2;) explicitly. This is done by finding an algebraic 
transformation of N so that the jump matrix on J becomes o) while the jump matrix on 
S \ J remains similar to the original one except that each fij changes to a different constant. The 
asymptotic condition as z — t- oo is unchanged. The solution to the resulting RHP is well known 

m- 

For constants ti, • • • ,t]y, let D{z) be a solution to the following scalar RHP: 



D{z) is analytic in C \ S and is continuous up to the boundary, 
D{z) / for all z G C\S, 
Dj^[x)D-[x) = f[x) for X £ J, 
D^{x) = D_(x)e**J for x G {aj,b. 



(249) 



J/' 



J 



D{oo) := lim^^^oo D{z) exists and is non-zero. 



For most choices of ti , • • • , i^v , there is no solution to this RHP. Below we construct a (unique) 
array oi ti, - ■ ■ ,t]\f for which D{z) exists. Note that D{z) is unique if it exists. 
Set 

L{z) = log D{z), z G C \ S (250) 

where log is defined on the principal branch of logarithm. The RHP for D{z) implies that L{z) is 
a well-defined analytic function in C \ S. Set q{z) := ny^o(^ ~ ~ '^j+i)- Define the square 



root q{z) to be analytic in C \ J and satisfy ^/ql 

L{z) 



N 

z) ^ z as z 
L{z) 



oo. Then the function 



(251) 



satisfies the following scalar RHP: L{z) is analytic in z G C \ S, continuous up to the boundary of 
S, and L(z) = 0((z - bj)"^/^ and Z(z) = 0((z - aj+i)y^/^ for j = 0, • • • , N, and also 



log /(a:) 



for X G J, 



L+(x) = L^(x)+ , 

L+{x) = L^{x) + itj for x G (oj, bj), j = 1, 
Z(z) = O(z-^-i) as z ^ oo. 



(252) 



45 



The additive jump conditions imply that, from the Plemelj formula, 



L(z) 




''j+i log/(s) ds 



i=l 



ds 



+ E{z) 



(253) 



for an entire function E{z). Now in order to satisfy the asymptotic condition L[z) = 0{z 



as 



z — >• oo, we must have that E{z) = and 



E 

j=0 " "0 



log/(s) 



s'^ds = for A; = O,--- ,iV - 1. 



(254) 



We regard ()254p as a system of linear equations for ii, • • • , t/vr. This system has a unique solution 
since its Jacobian is 



det 



'^ds 



N 



dsi 



IN 



(255) 



which is positive. For this particular tj, the RHP ()252p has a solution, and accordingly the RHP 
(j249p have a solution. Note that since i(y^ ^(•s)^) is real for s G J, the above system of equations 
has real coefficients and hence the solution tj are real. Prom this and (|253p . we find that D[x) > 
for all X £ (e, oo). 
Set 



N(z) := 



D{oo)-^ 
D{oo) 



N(z) 



D{z) 
Diz)-^ 



(256) 



for z G S \ J. It is easy to check using (j249p that N satisfies the same analytic and asymptotic 
condition as the RHP (j248p and it satisfies the jump condition 



N+(x) = N_(x) 
N+(a;) = N_(x) 









l' 
-1 



for X G J. 



for X G S \ J, 



(257) 



This is the same RHP (j232p for with the changes 0^ i— )■ Qj — ^tj. Hence the solution ^{z) is 
given by the usual Riemann theta function construction. Since tj's are real, we find, as in the case 
of Mfc, from the property of the theta function that for any x G (e, oo), [N]ij(x) x 0(1) uniformly 
in n, i,j = 1,2. Also from the explicit formula of N(z), we find that [N]ii(2;) > 0, — i[N]i2(x) > 0. 
Since D{x) > for x G (e, oo), we find by (I256|) that [N]jj(x) x 0(1) uniformly in n, i,j = 1,2, 
and [N]ii(x) > 0, -«[N]i2(x) > 0. 

Thus, as a special case, we obtain Lemma |7.2[ 
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8 Proof of Theorem 11.11 



Theorem II. II is an algebraic relation that reduce the higher rank case to the rank one case. We give 
an elementary proof of this theorem in this section. A different, more conceptual proof based on 
the integrable structure of the Hermitian matrix model with external source can be found in [7]. 

Since the proof is purely algebraic, we drop the dependence on n in the density function ([5]) 
and consider the following matrix model. Let W{x) is a nonnegative function on the real line 
such that \ogW{x) grows faster than any linear function as \x\ — )• oo. We also assume that the 
orthonormal polynomials po{x),pi{x), ■ ■ ■ with respect to the weight W{x) exist. Fix the matrix 
A = diag(ai, • • • , a^), and consider the following measure on the set T-ld oi d x d Hermitian matrix 
M: 

fd{M)dM := \ det(T^(M))e^'^(^^)dM. (258) 

Here W{M') is defined in terms of the continuous functional calculus of Hermitian matrices, and Z 
is the normalization constant. We emphasize that d is the dimension of both the random matrix 
M and the external source matrix A. 
For a subset C M and s G C, define 

^ d 

erf(ai, ■■■ ,ad;E;s):= 17(1 - sxE{Xj))fd{M)dM, (259) 
where Ai, • • • , are the eigenvalues of M. When A = diag(ai, • • • , am, 0, • • • ,0) for some m < d, 

d—m 

we suppress the zero eigenvalues of the external source matrix A denote (I259P by 

<Bd{ai,--- ,am;E;s). (260) 

We also set 

2<i(ai, • • • ,am;E; s) := . (261) 

^d{E; s) 

where ^d{E\ s) is (|259p when A = Q. For a real number a, define (cf. (jlOp ) 

Tj{a) := f pj{s)e'''W{s)ds. (262) 

Theorem 11.11 follows from the following proposition when W{x) = e~"^(^) and A = nA.(i = 
diag(nai, • • • ,nam,0, • • • ,0). 

Proposition 8.1. We have, assuming that ai, • • • are nonzero and distinct, 

det \Td-~j{ak)^d~j+i{ak]E;s)Y^^^^ 

€d{ai,--- ,am]E-s) = — • (263) 

det[rd_j(afc)J"\^^ 
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Proof. The density function of the unordered eigenvalues Ai, • • • , G M of Af induced from (j258p 
is a symmetric function and is given by 



1 



det[e"'^^ 



,a,;A,ld d 



z 



\{w{\i), (Ai,...,Ad)G 



(264) 



where Z' is the normahzation constant. Here the ratio ^'^^^^ is evaluated using rHopital's 

rule as Om+i = ••• = = 1- Recall that oi,--- , Om are nonzero and distinct by assump- 
tion. From the usual random matrix theory, the eigenvalues form a determinantal point process 
whose kernel Kd obtained from the bi-orthonormal system constructed from {l,x,x^,--- ,x'^~^^ 
and{l,x,--- , x'^"'""^, e°i^, • • • ,e"'"'^}. Then 



,a^- E- s) = dei[l - sPkdP] 



(265) 



where P denote the projection operator on the set E. 

Let Kd{x,y) = Yl^=Q'Pj{^)Pj{y)^{xY^'^W{yY^'^ be the usual Christoffel-Darboux kernel when 
A = 0. Hence <td{E- s) = det[l - sPKP] and £d(ai, • • • , E; s) 



Act[l~sPKaP] 
dct[l-sPKdP] ■ 



Note that the first d — m terms of the bi-orthogonal functions for Kd are the orthonormal 
polynomials Pj{x). It was shown in [3] that Kd is a rank m perturbation of Kd as follows. Define 
the column vectors 

t(x) := {Pd^m{x)W{x)'/^--- ,pd-i{x)W{xy/y, 
v(x) := (e"i^W(a;)i/2^--- , e^-^''Wix)^/y , 
and define an m x m matrix (the second equality follows from (]262p ) 



(266) 



B 



:= / i{s)v{sYds = [r, 
Jr 



d~ m+j — 1 



m 

j,k=r 



Set 



wi 



{z) := v(z) - / Kd{s, zMs)ds = [(1 - Kd)R^] (z). 



(267) 



(268) 



Then (The formula is equivalent to [3l Theorem 1] once one changes the monic orthogonal polyno- 
mials TTj{x) to the orthonormal polynomials Pj{x), and conjugate both sides of O Formula (19)] 
by W{xy/^ = e-5^(^).) 

m 

Kd = Kd + J2 ® (B-^t)j. (269) 
We now derive (j263|) from (I269|) . Let (, ) be the real inner product over M. Then (j269p implies 



that 



(Bd{ai,--- ,am.]E]s) =det 



det 



1 



1 -s^{{l - sPKdP)-^w)j {B-H)jP 
j=i 



I - s{{B'HP, (1 - sPKdP)~^w*^ 



(270) 



det[B" 



det 



B - s(t,P(l - sPKdPy^w^' 
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Set il^k{x) ■ = Then ij = il^d-j- By using the definition (j268p of w, we find that 

1 



<£d(ai,--- ,ain;E;s) 



det[B 



det 



m+j 



(1 - sP{l - sPKdP)-\l - Kd))vk) 



(271) 



j,k=i 



where Vfc is the A;th component of v. By arranging the columns backward and using (j267p . we 
obtain 



Lemma 8.1. We have 



det[Td-jiak)] 



m 

j,k=l 



det 



{^Pd-j, (1 - sP{l - sPKdP)-\l - Kd))Ok) 



j,k=l 

(272) 



Now the fohowing lemma shows that the subscript d of in the right-hand side of (|272p can 
be replaced by d — j + 1. 



Lemma 8.2. We have 



det 



{il^d-j, (1 - sP{l - sPKdP)-\l - Kd))^k) 



j,k=i 



det 



{i;d-j, (1 - sP{l - sPKd-j+iPy\l - Kd-j+i))irk) 



(273) 



(274) 



Proof of Lemma \8.^ We first observe the following general identity: for an operator A, if B 
A + f <^ f and if P is a projection, then 

(1 - sPAP)~^(l -A)-{1- sPBPy^{l - B) 

= (1 - sPApy^f o / + ((1 - sPApy^ - (1 - sPBpy^){i - b) 
= (1 - sPApy^f ® f - s{i- sPApy^pf fp{i - sPBpy\i - b) 

= (1 - sPAPy^f ® /(I - sP{l - sPBPy^{l - B)). 
Hence for any square integrable functions g and h, 

{g,{l-sPAPy\l-A)h) = 
{g, (1 - sPBPy\l - B)h) + {g, (1 - sPAPy^f){f, (1 - sP{l - sPBPy\l - B))h). (275) 

Also observe that since Kk = V'o®V'o + ' • •+^fc-i®V'A:-i) we have Kd-j+i = Kd-j + il^d-j^i^d-j- 
We denote the matrix on each side of the identity ()273p as L and R. Consider Rij. Apply- 
ing (|275p to A = Kd-j+i, B = Kd-j+2, 9 = ipd-j and h = Vk, we obtain 

Rjk = ii^d-j, (1 - sPil - sPKd^j+2Py\l - Kd-j+2))^k) 

+ (1 - sP{l - sPKd-j+iPy^)iJd-j+i)Rj-i,k- 

If we apply (j275p again with A = Kd~j+2^ B = Kd^j+s, g = ipd-j and h := v^, then we obtain 

Rjk = ii^d-j, (1 - sP{i - sPKd^j+3Py\i - Kd-j+3))vk) 



(276) 



+ ii^d-j, (1 - SP{1 - sPKd-J+2Py')i^d-j+2)Rj-2,k 

+ iiJd-j, (1 - sPil - sPKd^j+iPy^)iPd-j+i)Rj^i,k- 



(277) 
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Repeating this procedure j times, we obtain that Rjk equals Ljk plus a linear combination of 
Rj~i,k: ■ ■ ■ jRi,k- This implies that the determinant of R equals the determinant of L. □ 

For the spiked model of dimension d — j + 1 with the single spiked eigenvalue , ()272p implies 
that 

^d-j+iiak] E- s) = ^ \ M d-j, (1 - sP{l - sPKd-j+iP)-\l - Kd^j+i))vk). (278) 
i d~j{ak) 

Comparing with the right-hand side of (j273p . we obtain Proposition 18.11 

□ 
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